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for interactively navigating among 
the program segments. A usage 
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System for Distributing Personalized Audio Programming 



s field of the Invention 

This invention relates to electronic information distribution systems and more 
particularly to a system for dynamically and interactively selecting and playing particular 
programs from a program library. 

Background of the Invention 

0 The three dominant commercial systems for providing audio prograrnrning to a 

listeners are broadcast radio systems, cassette tape playback systems and compact disk 
playback systems. 

Broadcast radio uses both the AM and FM frequency bands making a large 
number of simultaneously broadcast programs available on an essentially random access 

5 basis. Unfortunately, since most broadcast stations attempting to appeal to the same 
general listening audience, much of the programming is duplicative and special interest 
programs are broadcast on a limited basis. In addition, because there is no convenient 
way for listeners to be aware of the wide variety of materials scheduled for broadcast, 
most people listen to only a limited number of stations which dependably broadcast the 

0 programming considered to be most acceptable. Even when desired programming is 
found, it must typically be listened to when it is broadcast; that is, at times chosen by the 
broadcaster and not the listener. 

Tape and compact disk audio players .offer ^ the listener the opportunity to purchase 
specific music selections or albums performed by fevorite artists and to replay selections 

5 from these purchased recording whenever desired. Pushbutton track selection, as well 
as improved fidelity, has made the CD player the preferred choice of many, despite the 
cost and inconvenience of purchasing a library of desired disks. Unfortunately, specialized 
information programming, unlike music, is largely unavailable on tape or disk, and that 
media is not capable of adequately conveying rapidly evolving information such as local 
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and world news, weather reports, and rapidly changing trade and business information 
Although broadcast radio provides adequate, up to the minute coverage of general news 
topics, specialized information continues to be largely unavailable on any of these three 
audio delivery systems, notwthstaiiding the feet that radio, tape and CD players continue 
to be widely used, particularly in automobiles, for general news and music programming. 

More recently, Thternet radio" soiirces has been tatroduwdwMchniake files of 
audio program material available for downloading on the Worid Wide Web using 
conventional web browsers to locate and request specific files which are then played in 
real time by special programs, including the popular "Real Audio" program offered by 
Progressive Networks. Although Internet radio systems make it posaftle to ddiver a 
richly diverse selection of audio programs to mterested hsteners on request, indud^ 
specialized ^information not offeiied by coiwentional broadcast media, the use of a ^ 
web browser to search for and men play mdmdual program selections one at a time makes 
conventional Internet radio players impractical for routine desktop use, and wholly 
unsuitable for use by an automobile drive. 

It is accordingly an object of the present invention to provide easy access to rich 
selection of audio programing and to aUow the listener to ^ 
locate and select desired programming from the available collection in an easy and 
nttiitrvewaywi^ 
controls. 

*■ 

Summary of the Wn*i> n 

In a principle aspect, the present invention take the form of a personalized 
information delivery system which provides information and entertainment prograimming 
toiwfrvidualsi*^^ 

and which incorporates mechanisms for selectively delivering a subset of those program^ 
to a given subscriber based on mat «*scd^s cl^racteristi 
and interests, and express requests. 

As contemplated by the invention, the library of programs is created and 
maintained by a server subsystem to which a remotely located subscriber / player 
subsystem can comiect^ 
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up Internet collection. The programs making up the library are subdivided into program 
segments, one of which contains an audio presentation of the content of the program and, 
if that content includes a voice narrative, it is preferably accompanied by a text file 
transcript Each program segment is associated with a subject category description which 
typically describes a plurality of related program segments, and a program topic 
description describes the content of each individual program segment. Combinations of 
these category and program descriptions which are of interest to a particular subscriber 
are tauwferred from the server subsystem to that subscriber's player subsystem, thereby 
providing a subject matter catalog from which the subscriber may expressly request 
particular programs. 

In the preferred embodiment of the invention, to facilitate use of the system by the 
subscriber, the server subsystem accepts from the 8ubscnT)erm£lications of the subscriber's 
general interests, characteristics and preferences and this subscriber characterization data 
is periodically matched against the characteristics of each stored program segment to 
identifytiiose segments of significant potential appeal to tiiat subscriber. The catalog of 
programs supplied to the user may accordingly be limited to, or otherwise emphasize, 
categories and selections to which the subscriber's attention should be specifically 
directed. 

In orderto match the subscriber's preferences to the programming most likely to 
match those preferences, the server subsystem creates date for each program segment 
characterizing a series of attributes of persons likely to have an interest in that program 
segment The server &rther includes mea^ 

against the attributes of each program segment to form a weighted value indicative of the 
extent to which the preferences of the subscriber match the attributes of the target 
audienceforthat program Programs which have the highest weighted value for a given 
user are men brought to the attention of that user, either by including those programs in 
the user's catalog, or by including the program in an acxud proposed Usteiimg schedule 
when space permits. 

Other aspects of the audio distribution system m^ 
the listener to add a voice annotation to a program and send me annotated program to 
another listener, tecnmques forsyMl^ 
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or more stored images, techniques for employing a usage log generated by the listener's 
activity to determine what jrogrammihg should be distributed to the user, and techniques 
for responding to control commands received from the user in providing the 
programming. 

These and other objects, features and advantages of the present invention may be 
more completely understood by considering the following detailed description of a 
preferred embodiment of the invention. In the course of this description, reference will 
frequently be made to me attached drawings. 

Brief Description nf Hip n raw j n ^ 

FIG. 1 is a block schematic diagram of an electronic program and advertising 
distribution system which embodies the invention; 

FIG. 2 is a flow chart illustrating the prmcuile steps foUowed in the course of the 
performing the information distribution functions contemplated by the invention; 

FIG. 3 is a flow chart illustrating the principle steps performed during a playback 
15 session in the illustrative embodiment; 

FIG. 4 is an information structure and data flow diagram illustrating the manner 
in which programming is selected and accounting functions are performed in the 
illustrative embodiment of the invention; 

FIG. 5 is an information structure diagram illustrating the manner in which the 
program segments are dynamically selected and played in response to the user's 
preferences and control decisions; 

FIG.. 6 is a flow chart which describes a preferred procedure for preparing the 
program content which is distributed to subscribers in accordance with the invention; and 
FIG. 7 is an information structure diagram illustrating the manner in which a 
Mrrauve text file expressed in hypertext markup language (HTML) may be translated in 
fothecombiiiationofanautt^ 
by the player to create a multimedia presentation. 
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Description nf th« PrAforr^ Emhnrii«m» n t 

The illustrative embodiment of the invention shown in Fig. 1 utilizes the Internet 
to provide communications between a host computer indicated generally at 101 and an 
audio player device illustrated at 103. 

Subscriber Audio Flayer 

The player 103 may be advantageously implemented by a conventional laptop or 
desktop personal computer including a processor (the client CPU 105), a time of day 
dock i06, and a data storage system consisting of both high speed RAM storage and a 
persistent mass storage device, such as a magnetic disk memory, the oata storage s^ 
being usedfor storing audio, text and image data at 107 and for storing usage data at 109 
>vMch records the iiature of tte^ 103 n^p^ 

103 father includes a sound card 1 10 which receives audio input from a microphone input 
device 1 1 1 for accepting voice dictation and commands from a user and which delivers 
audio output to a speaker 113 in order to supply audio information to the user. The 
program data stored at 107 may advantageously include compressed audio recordings 
and/or text (files of characters) which may be converted into audio form by conventional 
speech synthesis programs executed by the client CPU 105. 

The sound card 110 is conventional and preferably complies with the 
recmnmendatioijs detaUed m Hardware DesiVn fluids for MW„, n ft winHnw. os 
bylfcugKiopfen^ 1-55615-642-1. Thesoundcard 

1 10 advantageously supports a 44 kHz, 16«t, stereo codec providing analog to digital 
conversion of audio input signals from the microphone 111 as well as digital to analog 
conversion for prograrnming directed to the speaker 111. The sound card provides 
external connections and hardware support for Mcrophone-fy 
Headphones-Out, with volume controlled by the player software Occluding volume 
level logging as discussed later in connection with Fig. 3 of the drawings). 

To support multimedia capabilities, the CPU 105 should meet or exceed the 
capabilities of an Intel 486 DX2-66 computer to provide consistently good playback 
results and the sound card 1 10 should include it 16-bit digital-to-analog converter for 
playback and a 16-bit analog-to-digital converter for recording. The sound card 110 
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shouldfiirthersupportS, 11, 22, and 44kHz waveforms. A frequency of 44kHz is used 
for CD-quality sound and fractions of 44, such as 11 and 22, are often used for 
compressed wavefora^ Support for an 8kHz frequency 

should be in order to properly support Windows 95 TrueSpeech™ compression, which 
is optimized for compression and playback of human speech. Using TrueSpeech 
compression, programs containing largely voice narrative data can be substantially 
condensed, and users can record annotations and voice mail responses as discussed 
later. 

In addition, the sound card 1 10 should be <^able of reproduckg downloaded 
MIDI (Nfiisical Instrument Device Lrterfece) commands, enabling the system take a 
MIDI data stream and produce sound according to the compressed files consisting of 
digital sheet music instructions. Preferably, the sound card should support at least 16- 
voice polyphony (the ability to play several sounds at the same time), and polymessage 
MIDI, an capability included in Windows 95 that allows a sound card to receive and 
IS ' batch-process multiple MIDI messages (such as Note On and Note Off). The sound 
card 110 should also a microphone port for microphone 111, a speaker-out port (for 
one or two (stereo) unpowered speakers 1 13, and a headphone-out port. 

The personal computer CPU 105 is also preferably connected to a conventional 
personal computer video display 118 ai^ 

device (such as a mouse, trackball or touchpad, not shown). The facilities provided 
by the operating system, such as Windows 95, typically includes multimedia support, 
as noted above, as weil as a standard WINSOCK TCP/IP stack and modem dial up 
driver software to support a SLTPP/PPP Internet connection, as next discussed. 

the player 103 further includes a conventional high speed data modem 1 15 fer 
25 re <*^(4owri<)a<lmg)fo 

transmitting (uploading) program selections and preferences as well as usage data in the 
file 109 to the server 101. To effect these file transfers, the modem 115 is connected via 
conventional dial up telephone SLIP or PPP. TCP/IP series data communication link 117 
to an Internet service provider 121 which provides access to the Internet. The service 
provider 121 is in turn connected to the host server 101 via a high speed Internet link seen 
at 123. 
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Host File Server 

The host server 101 provides a FTP server imer&ce 125 which provides file 
transfer protocol services to the player 103, a CGI inter&ce 127 which performs Common 
Gateway Interface script program execution in response to requests from the player 103, 
and an HTML inter&ce 129 which provides hypertext transport protocol (HTTP) World 
Wide Web server functions to the connected player 103. The host server 101 stores and 
maintains a plurality of data files including a program data library indicated generally at 
130 consisting of a collection of compressed audio program segments 131, announcement 
("glue") segments 132, text program segments 133, image segments 134, advertising 
segments 135 and program catalog information 137. 

The compressed audio segments program segments comprise audio voice and 
music files which may be compressed using conventional compression mechanisms suited 
to the data being compressed, such as TrueSpeech compression for voice signals and 
MIDI files for compressed synthetic music reproducible by the sound card 1 10 as noted 
earlier. 

Compressed voice prograinming in the database 131 may advantageously be 
accompanied by text transcripts (files of characters) stored in the text database 133. 
' Simflady, images stored in the image database 134 may be used to provide a multimedia 
presentation which combines images reproduced on the display 1 18 of player 103 with 
concurrently presented audio at the speaker 1 13 and/or displayed text. Program segments 
which present advertising , iUustratively shown as being resident in a separate database 
135 in Fig; 1, may likewise consist of audio, text and/or'image segments, as may the 
program segments which provide announcements between program segments as well as 
audible and visible menu options which the user may select as described later. 

As hereinafter described in connection with Fig. 5, each voice or text program 
segment preferably includes a sequencing file which contains the identification of 
mghBghted passages and hypertext anchors within the program content This sequencing 
file may farther contain references to image files and the start and ending ofi&et locations 
in the audio presentation when each image display should begin and end. In this way, the 
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iir^epr^tadonn^be synchronized^ 
multimedia programming. 

Asconteiiiplatedbythenwen^ 
newssources, Bbnuies, etc/^becoiwerted to^^ 

reader* or by conventional speech synthesis. If speech synthesis is used, the conversion 
of text to speech is preferably performed at the client station 103 by the player. In this 
way, text information alone may be rapidly downloaded from the server 101 since it 
requhes inucAless datathan eq^ 
iuru^providesttei^^ 

cases, where it is important to capture the quality and authenticity of the original analog 
speech signals, a text transcript file which collaterally accompanies a compressed voice 
audio file may be stored in the database 133 from which a transcript may be made 
available to the user upon request. 

The host server 101 former stores web page data 141 which is made available to 
the player 103 by means of the HTML mterface 128. The host server 101 addmonaUy 
stores and maintains a user data and usage log database indicated at 143 which stores 
uploaded usage data received from the store 109 in the player 103 via the Internet 
pathway 123 and the FTP server interface 125. The user data 143 further contains 
additional data describing the preferences, demographic characteristics and program 
sdections unique to each subscriber which is developed largely from user-supplied data 
obtained \vhen users submit HTML form data via the Internet pathway 123 for processing 
by the CXH mechanism 127. 

Ihe host server 101 periodicaUy transmits a dowdoad ^ 
naarfving a request from the player 103, The file i45 is placed in a predetermined FTP 
download file directory and assigned a ffle^ Audme 
determined by player 103 momtoringfoetimeofday docfc 106, a 
established via the service provider 121 and the Internet to the FTP server 125 and the 
download compflation 145 is transferred to the program data store 107 in the player 103. 
The ,compaation 145 is previously written to the download directory by a download 
*roc^,necha^^ Dowdoad proce^ as described 

in more detail later, extracts from the library 130 data defining compressed program, 
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advertising, and glue segments, and/or associated text program data, based on selections 
and preferences made by (or inferred for) the user as specified in the subscriber data and 
usage log database 143. 

The download compilation file 145, though represented as a single file in Fig. 1, 
s preferably takes the form of one or more subscriber and session specific files which 
contain the identification of separately stored sharable files. By way of example, the 
recommended order and the identification of the program files making up an individual 
playback session are stored in a session schedule file (to be described in detail in 
.connection with Fig. 5) which contains program identifiers of the program segments to 
10 be played during an upcoming session. The player 103 downloads the session schedule 
file and then issues download requests for those identified program segment files which 
are not already available in the player's local storage unit 107. 

Usage data in the store 109 maintained by the player 103 is preferably uploaded 
as a file bearing a predetermined file name indicative of the particular subscriber and 
upload time and stored in a predetermined FTP upload (firectory. This upload 
advantageous^ occurs atthe same time the player 103 establishes a download connection 
to the FTP server 125 as noted earlier, and occurs prior to the download of the 
compilation 145 r Because the upload data from the store 109 in the player 103 identifies 
program segments desired by the subscriber, program segments newly requested by the 
user are appended to the compilation 145. Note that, in typical cases, programming in 
addition to the specifically requested programming will be included in the download 
compilation, and the transfer ofthatprogramnung canbegkiirra 
uploaded user selections and other information are being processed as indicated at 153 to 
identify additional information to be included in the download compilatioa 

As indicated at 161 in Kg. 1, the host server upload processing mechanism 153 
also provides a number of reports, as described in more detail later, based upon the record 
of actual player use by indrvidu^ 

This report processing is advantageousry performed on a periodic basis in connection with 
financial and accounting functions induding subscriber and advertiser billing, content 
provider royalty payment accounting, and marketing analysis processing. 
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It should be understood that numerous other information storage, processing and 
coranunicatibns schemes may be substituted for the preferred Internet server and PC 
client player luchitecture shown in Fig. 1. A dedicated host computer which 
communicates directly with client stations via dial up telephone facilities may be used, and 
cellular radio, cable modem and satellite links may be used to provide data 
coimnuiiicatiorismu^oftheco^ 
mFig.1. TofiuMtateiiseofto 

linked to the Internet via a local communications server computer via a radio or infrared 
link when the car is parked at the subscriber's home or office: The Infrared Data 
Association's (&DA) wireless infrared QR) standard provides a highly effective, low-cost 
cornmumcations pathway rapidly becoming a standard feature in all notebook computers 
and PDAs. The LDA international standard provides interoperability among widely 
diverse systems, involves no governmental regulation, are provided at low cost, provide 
l^speedffletnuisfe re (e.g., 4Mbs data rates), are smafl and can 
into portable computers of the type which may be used in a car or on public 
transportation. Alternatively, the files downloaded from the host may be stored on a 
replaceable media, such as. an optical disk cartridge, which may then be inserted into a 
portable computer or simplified player for mobile use! A direct link between a mobile 
client player (such as a laptop PC) may be implemented using the Cellular Digital Packet 
Data(CDPD) service presermy available*^ 

access to the Internet using the TCP/IP protocol, and provides the advantage that needed 
program segments can be downloaded while a session is in progreis, eliminating the need 
for a complete download before the mobile unit is disconnected from its data source. 

Upload and Download Sequence - Overview 

Kg. 2 illustrates the sequence of major events which are executed the program 
d i sse m i n ati o n system contemplated by the inventioa 
As indicated at 203, an mterested subscriber to 
supplying personal information and mitid r^gtamn^ ^ 

tofcauartion procedure. Preferably, as explained in more detail later, account 
initialization is accomplished by presenting the subscriber with HTML forms to complete 
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and submit to CGC script programs which execute on the server to post subscriber 
supplied information into an initial user dataset. Based on the information supplied by 
the user, the server then compiles one or more files for downloading to the subscriber at 
step 207 which include programming and advertising segments as well as additional date 
and utility programs needed by the player 103 to begin operation. The download 
operation preferably occurs at a time established by the player which establishes a dial up 
connection via the SLIP/PPP serial connection 117 to the local Internet service provider 
121 which provides an Internet connection to the host FTP server 125. The download file 
or files containing programming and advertising segments as well as subscriber specific 
data are designate by filenames provided by the requesting client/player 103 and moved 
ftom storage unit 145 utilizing the FTP server 125 ana the Internet connection into local 
storage at 107 in the client/player 103. The filenames used to specify the files In the 
server 125 may conveniently be formed from the programed value used internally by both 
the host and the player to identify and differentiate the different program segments used. 

The data downloaded includes a recommended program sequence file which 
provisionally identifies the order in which downloaded program segments are to be played, 
with the initial selection and sequence being established based on user preference data by 
the download compilation processing mechanism seen at 151 at the server. 

Before a playback session begins, as indicated at 211, the subscriber has the 
opportunity to review and alter the provisional program selections and sequence 
established as a defeult by the downloaded information ftom the server. Utilizing the 
programming data and a utility program previously supplied by the server, the subscriber 
may alter the selection and sequence of program materials to be played, including altering 
the extent to which advertising wfll be played along with the selected prograinming. 

At the request of the user, the sequence of programming defined by the program 
sequence file (the selections file illustrated at 351 in Fig. 5) is then reproduced for the 
listener. As contemplated by the invention, the player 103 includes controls which enable 
the user to easily move ftom program segment to program segment, skipping segments 
in a forward or reverse direction, or to jump to a particular segment, and thus aher the 
preprogrammed sequence. Nevertheless, when uw given program segmert concedes, 
the next segment which is specified as following the given segment wfll begin playing 
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unless the listener intervenes. Thus, although the segments are stored in randomly 
addressable locations in the local mass storage unit, they are nonetheless played at step 
212 in the sequence established initially by the server and (optionally) modified by the 
subscriber, with the player providing the ability to dynamically switch to any position in 
this sequence under the listeners control. As indicated at 213 in Fig. 2, the listener may 
at any time return to the sequence editing step 21 1 to manually reorder the playing 
sequence if desired. As indicated at 215, a session usage log is recorded during the 
playback session to identify every segment actually played, the volume and speed at which 
that segment was played, and the start and end times. 

At step 211, in addition to deleting and reordering items on the program schedule, 
the user may alter his or her selections and general subject matter preferences to control 
the manner in which the host assembles program schedules for future sessions. When 
inx^grams areiiu^edmaciii^ 
may assign apriority viu^ 
the user has an interest m 

categories in which the idemffied program is classified. When a program in a serialized 
sequence is assigned a new or different priority value at step 21 1, the host system 101 
assigns a corresponding Importance value to me program_seg^ 
remaining unplayed programs in that serialized sequence. Note that, by expressly 
approving advertising segments or categories of acceptable advertising in this fashion, the 
subscriber may be granted a rate reduction since advertisers are generally willing to pay 
more for advertising clirected to customers having a known interest in a given subject 

At the conclusion of a session, subscriber is given the opportunity at 217 to select 
programnu^g which sh(»uMoera Tofiicilitate 
this selectionprocess, additional |»^grammii« which fts the subsc^^ 
mattepreferences,8^ 
of particular inters 

download file seen at 308 in Fig. 4) and presented to the user in the form of a proposed 
projgram schedule together with a catalog of additional selections which may be 
arostiiutedorn^ At step 219, we selections made by 

the user at 217 as well as the contents of the usage log recorded ai 215 are uploaded to 
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the server as a requested file (seen at 301 in Fig. 4). This upload step may occur at the 
same time the SUP/PPP dial-up connection is established by the player 103 to accomplish 
thedownload, with the upload occurring first by an FTP file tiarisfefiwm the usage data 
store 107 to the FTP server 125 followed by the downloading of files requested by the 
5 client 103 from the FTP server. 

In addition to the downloaded catalog of available items which may be viewed by 
the subscriber from the available downloaded information, the user may re-establish an 
Internet connection to the HTML web server 129 which presents HTML program 
selection and search request tonus, enabling the subscriber to locate remotely stored 
10 programming which may be of particular interest to the subscriber. When such programs 
are selected in the HTML session, the user's additional preferences and selections maybe 
posted into the user data file 143 and the identification of the needed files may be passed 
to the client/player 103 for inclusion in the next download request. 

Account Initialization 

1S As contemplated by the invention, a subscriber account may be established by any 

user having a personal computer equipped to provide the capabilities needed to implement 
the player 103 as described above, together with Internet access via a service provider 
121. Although a conventional modem dial up connections will perform satisfactorily, the 
time required for uploading and downloading the necessary files may be substantially 

20 reduced using higher speed access, such as an ISDN or cable modem link, when those 
services are available. 

To establish a new account, a prospective subscriber may use a conventional web 
browser program, such as Mosaic, Netscape Navigator or Microsoft's Internet Explorer, 
whichexecutesmmeckertCTU 105 to establish a coiiventioiid HTTP request/r^ 

2$ dialog with server 101. The account initialization begins with the transmission of an 
HTML form from the web page store 141 which is completed by the user at the keyboard 
(not shown) of the client CPU 105. The account information is then transmitted to using 
aiuTi» post method directed at a form processing CCH script executed by the server at 
127 to place descriptive information about the user in an assigned user data file as seen 

30 at 143 . After the. account has been established, utility programs and data may be 
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downloaded from the FTP server 125 to the cheht/playef 103. These utility programs 
advantageously include programs which perform functions including . (a) program 
decompression, playback and navigation; (b) recording of a usage log file identifying the 
program and advertising segments played and the start time, ending time, volume level and 
playing speed for each such segment; and (c) the selection and updating of programming 
preferences and selections for future downloading. 

The data fields supplied by a new subscriber at the initialization step 203 may 
advantageously include the user's full name and billing address, credit card information 
or the like for use in subscriber billing; and descriptive data about the subscriber (and 
others who may share the downloaded material), such as: age, profession, sex, and marital 
status; the identification of subject matter categories of interest to the subscriber, 
preferably with assigned weighting factors indicating the level of interest in each category. 
The subscriber may also indicate general preferences with respect to the including 
advertising, including an indication of the amount of advertising which is acceptable to 
defray subscription costs, ranging from fully advertised programming for miiiimum 
subscription charges to the complete exclusion of advertising. 

In addition, the subscriber may request and be presented with an HTML form 
which lists available programs in a particular selected subject matter area, with a priority 
weighting factor pre-assigned to each in accordance with the subscriber's previous 
specification for that category. The form presented thus reflects the previously entered 
level of interest weighting factor for each program based on its subject matter category, 
but permits the subscriber to override the suggested default value on a program by 
program basis. Similarly, the subscriber is given the opportunity to override the default 
amount of advertising desired. 

Advertisingmay be associated with particular subject matter categories w 
with particular programs. For example, an airline may wish to advertise generally in 
connection with programming in the "travel" category whereas a particular resort hotel 
may wish to advertise only in connection with a particular travelogue program for the 
region where it is located. Subscribers may wish to hear advertising in connection with 
the progimming in the travel category, but to eliminate commercials from a daily 
inogr8jnjareseiirii«nod^^ The result is clearly advantageous for the 
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advertiser, since advertising is focused more clearly on those having an interest in the 
subject matter and an expressed willingness to listen to commercial messages, while the 
subscriber is able to receive advertising which may be regarded'as useful while eliminating 
unwanted advertising. 

Because personal data describing each subscriber's subject matter interests is 
available, along with: personal data (age, marital status, zip code, etc.), particular 
advertising segments may be directed to only those subscribers having a likely interest in 
the goods or services advertised. This targeted advertising need not be presented at any 
time during the playback for the designated subscriber and need not be timed for 
presentation with particular programs. For example, a subscriber indicating an interest 
in travel programming may be supplied with advertising from an airline at any time, and 
not necessarily concurrent with selected travel programming. 

Because a subscriber may have a particular interest in or enjoy some advertising, 
and may have a particular dislike for other specific advertising, the user may 
advantageously be presented with a listing of advertising organized by advertiser and 
subject, providing the subscriber with the opportunity to select additional desired 
advertising on the list while suppressing others: Since the voluntary acceptance of 
advertising preferably reduces the progranuning charge to the subscriber, the utility 
program which executes on the client CPU 105 to enable program and advertising 
selection, sequencing and editing preferably provides an advisory indication to the 
subscriber of the charges or credits to be accrued if the currently programmed sequence 
is played. This feature enables subscribers to better control the costs of the service by 
accepting sufficient advertising content to reduce the subscription cost to an acceptable 
level. Subscribers may also set a player system variable to a value indicating the 
subscription costs per unh tirne that the subscriber is willing to accept, and the player 103 
can then automatically insert advertising segments between program segments in sufficient 
quantity to achieve a net charge at the desired level. 

Player Operation 

The playback operation indicted generalh/at 212 in Fig. 2 is illustrated in more 
detail in Fig. 3. 
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In order to limit access to the downloaded prognuruning materials to the 
subscriber or persons authorized by the subscribe, the playback utility program executing 
on the client CPU 105. (Fig. l)^m$m^\^^m^bfw^^^ 
ofapasswordasindicatedat231. The entry of this or a different password mayalsobe 
required for access to the utility programs used to modify me subscriber's pemna! da^ 
fitture program selections, and current program selections and sequencing. Sinulariy 
information which might be revealed concerning an individual subscriber by the hosi 
server 101 is advantageously password protected. 

As with all Internet transactions, the actual data transmissions of information other 
than publicly available programming may also encrv^ To this end, the client and 
server ends of me pattway may exchange puM^ 

usmg conventional RSA encryption. By placing the decryption capability within the 
<^ab%oftheplav^ 

system's speakers and display screen,but not to a rile, me system insures that the internal 
usage accounting mechanism cannot be bypassed by reproducing downloaded program 
segments using other means, m addition, and as a part of this secure accounting 
arrangement, the host system can be progiainmed to require me n^pt of an uploaded 
usage log (fiom which subscriber and advertising charges and content provider payments 
can be determined) before releasing addmo„al progra nmu^ 
from the FTP server 125. 

As described in more detail later in connection with Figs. 4 and 5, the sequence 
Pfi^gram segments to be pres^ 

inF«. 4) consisting of a sequence of program segment identification numbers which are 

used to compile a sequencing file, called the selections file, iUustrated at 351 in Fig. 5 

which contains more detailed information about the sequence of events which occur 

duringplayback. The player obtains infonnation from th^s 

theirdividudprogramsegir^ 

asweflasthesegmertidentak^ 

in the manner illustrated in Fig. 3 . 
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As indicated at 233, the playback session begins with the presentation of an audio 
(and/or displayed) menu which allows the user to jump to any program segment within 
that sequence to start (or resume) playback at 235, or terminate the session at 236. 
The playback operation itself continues from the designated playback point in the 
selections file (seen at 351 in Fig. 5) which follows a program sequence initially created 
by the host server and downloaded with the program segments themselves, and then 
(optionally) modified by the addition, deletion and re-sequencing of segment identifiers 
as discussed earlier in connection with step 211 in Fig. 2. Note however that, if the user 
elects to have advertising segments automatically inserted between program segments to 
achieve a predetermined cost level, that insertion occurs under the control of the playback 
mechanism at 235 such that advertising segments not identified in the selections file may 
be added or advertising segments specified in the selections file may be automatically 
skipped. 

As playing progresses, the current playback position may be advantageously 
•indicated by a variety of means. In the most simple form, the current playback position 
within the session file of selections (discussed in more detail in connection with Fig. 5) 
may be indicated by a simple numerical readout indicating the position on a scale of 1-100. 
In this way, a user listening to the programming in scheduled order is provided with an 
indication of the duration of programming remaining to be played. In a player 
implemented by a personal computer provided with a screen display, the current playback 
position may be advantageously indicated by displaying the program segment topic 
descriptions in a scrolling listing, with the description of the program currently being 
displayed being highlighted. The scheduled duration of each program segment may be 
displayed, along with the elapsed time remaining to be played in the currently playing 
segment, to enable the user to more easily determine when to skip the remainder of the 
currently playing segment. When such a concurrent visual display is available, means may 
also be included to respond to the users selection of a given program on the scrollable 
listing by means of a mouse or the like, and then automatically continue the play at the 
beginning of the program segment thus selected. 

Each time the playback begins a new programming, advertising or announcement 
segment, the segment start time is recorded in the usage log file stored at 109 (Fig. 1). 
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Each usage log record contains a program segment identification number (Program©) 
obtained from the selections file as well as a start time and date stamp encoded into a 32 
bit date-time value, a volume level setting indicating the volume at which the player was 
set at that time, and a playing speed value indicating the playing speed or playing being 
used. 

As indicated at 237 in Fig. 3, each time a new program segment is started, a hew 
segment handling procedure is executed at 239. If the user desires to have advertising 
inserted to defray the costs of the subscription, the current actual cost per unit time is 
cateulat^ Ifthecostisdetenninedto 
exceed the desired level, an additional advertising segment is started; otherwise, the next 
program segment in the program sequence 214 is played. In either case, the segment id 
of the newly starting segment is recorded in the log file along with the start time for that 
segment. Note that it is unnecessary to record the end time for the prior segment since 
it is the same value as the start time for the next segment. When play is concluded, a 
temunating record indicating the time of turnoffis recorded to enable the duration of Ae 
last segment to be calculated. 

Recording Volume and Playing Speed Changes 

As indicated at 251, if the user changes the volume level or playback speed by a 
significant amount, a new record is posted to the usage log at 253, indicating the 
continuation of the last program at a new volume level (thus producing two records in 
sequence haying the same program segment ID numbers but having differing start times 
and volume levels). The user adjusts the volume by means of a software control 
displayed when the player is active. The user adjusts the control using the mouse or 
keyboard to adjust the volume. When the volume control experiences a change in level 
greaterthan a predetermined deviation, it sends a message to the player routine at 251 to 
cauathenew voaime levdtoberecoraed at 253. New volume settings do not affect the 
program sequence and the leconUngofthe volume level change takes place transparently 
totheuser. likewise, when the usw 

mode, the new playing speed setting is recorded (using the PlayingSpeed variable in a 
Usage Record, to be discussed) 
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The cost accounting program which calculates subscriber charges and fees to 
advertisers may thereby treat volume levels below a predetermined threshold level, or 
playing speeds in excess of a certain level, as being equivalent to skipped progratroning. 
In addition, if a subscriber reduces the volume on selected programs or programs in 
particular subject matter categories, frequently increases the volume for other programs 
or subject matter categories, or sets the playing speed to play highlights only of other 
programs, that data can be used to infer preferences and dislikes which can be used to 
better select desired programining to be included in future download (Ampliations. 

User Playback Controls 

The player mechanism seen at 103 includes both a keyboard and a microphone for 
accepting keyed or voice commands respectively which control the playback mechanism. 
As indicated at 261, the receipt of a command, which may interrupt the playback of the 
current selection, and the character of the command is evaluated at 262 to select one of 
six different types Of functions. 

The player 103 responds to the first command, "Accept" indicated at 263, by 
temporarily suspending the playback in order to accept a spoken "comment" from the 
user which is recorded as indicated at 264. After the conclusion of the comment, control 
is returned to 261 to test for additional commands before playback is. resumed at 235. As 
described in more detail later, comments dictated by the user are saved and later uploaded 
to the host system where they exist as program_segments. By allowing the user to dictate 
and record comments, the system provides a number of useful capabilities, including 
posting comments and messages to the host (requests for help or additional information), 
posting comments and messages either privately or publicly to the originator of a program 
segment being played, thereby enabling private interchanges to occur between users, to 
enable the interchanges to take place in publicly available threads analogous to the UseNet 
and Ustserv newsgroups employed on the Internet to facilitate public discussions related 
to predetermined topics. In addition, the ability to accept and upload user-generated 
comments and information provides a valuable mechanism by which the user can evaluate 
and comment on the program material being provided by the host. As described later in 
connection whh Figs. 5 and 7, the mechanism seen at 263 and 264 for wtroducing a pause 
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in the session playback while a voice response or comment from the user is recorded can 
also be employed to produce program generated prompts which request information 
followed by automatic response recordings, thereby enabling the system to be used to 
collect data, program evaluations, and other information from the user.** 

A first command, "Go" indicated at 265, causes the player to make an immediate 
shift to a different program segment. For example, the spoken voice command "FIVE" 
can indicate a request to go to a predetermined numbered program segment while the 
spoken command "NEWS" could switch to the subject announcement segment for news 
programs . Alternatively, a mouse click on a screen-displayed menu of items, or a push- 
button on a hand controller connected by an infrared link to the player computer, could 
similarly be processed as a command to go to a predetermined program segment 
associated with that command signal. In such cases, the system records the start of the 
new segment on the log file (seen at 215. in Fig. 2) at 267 and switches the current • 
playback position in the program sequence file 214 to the new setting at 269, and the 
playback continues at 235. 

In the preferred arrangement, described in more detail in conjunction with Fig. 5 
of the drawings, the program being played may contain passages which relate to other 
program segments in the compilation. These passages may be indicated by direct 
announcement, such as: "Say 'Go' when any of the following automotive companies are 
named to obtain additional informatioh: .. Ford ..General Motors .. Chrysler .. Honda .." 
Alternatively, an audible cue signal, such a distinctive tone or chime, might immediately 
precede a passage which anchors a link to another program segment. Players equipped 
with stereo audio output capabilities can make , cues distinctive' by playing cued 
announcements in one stereo channel, with or without a supplemental cue signal in the 
other channel. When a cue signal indicates a hyperlink passage, a simple "Go" voice 
command causes the player to reset to a new location from which playing continues until 
a "Return" command, seen at 266, causes the player to return to the original sequence. 

As discussed later in connection with Fig. 5, hyperlinks of this type may be used 
to idaitify program segments which are not available in the player 103 because they were 
not downloaded for inclusion in a scheduled session. In that event, the "Go" handling 
routine seen at 265 posts a record to the usage log containing the ProgramID of the 



20 



WO 99/43111 



v 



PCT/US98/03444 



requested but unavailable segment so that the requested segment can be included in the 
Requested file 301 seen at 301 in Fig. 4. . 

When a communications pathway such as an Internet or cellular phone link is 
available to connect the player 103 to the server, an immediate request may be sent to the 
server to download a needed but locally unavailable segment. Li that case, the 
dowiuoading and playing may proceed concurrently by placing the downloaded 
information into a memory buffer to which the downloaded program segment is written 
as it is concurrently read for reproduction as described U.S. Patent 5,371,551 issued to 
James Logan and Daniel F. Goessling. To eliminate breaks in the program sequence, the 
player 103 may advantageously perform a look-ahead operation, sending a file request to 
Ae file server via the communication link by pre-scanning the program sequence.file 214 
to identify program segments to be played which are not in local storage and requesting 
those segments before they are needed. 

Because announcement or "glue" segments are frequently repeated in different 
program segments, these segments are preferably retained in local storage by the player 
to avoid the need to be downloaded. The player advantageously processes the usage file 
at the end of each session and tags each program segment which has been played as being 
.eligible for replacement to make room when necessary for incoming segments. 
Announcement segments, however, are preferentially retained even though they have been 
played because of the higher probability they may again be included in upcoming session 
schedules. 

The third command, the SKIP command indicated at 275 in Fig. 3, causes the 
player to advance to the beginning of the next program segment in the program sequence, 
lecqnfing the start of the next sequence at 267 and resetting the playback position at 269. 
If the program segement has been subdivided (e.g. into paragraphs), the SKIP command 
causes the player to skip forward to beginning of the next subdivision within that segment 
If desired, SKIP commands may be subdivided into two types, a SKIP TOPIC command 
and a SKIP SUBJECT command. When programming material such as news reports are 
grouped into topics within subject categories, as described later in connection with Fig. 
5, a SKIP SUBJECT command allows the user to skip over all program segments within 
that subject and resume playback at the leading description of the next subject. In 
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contrast, the SKIP TOPIC command always advances to the next topic (program segment 
or program segment subdivision) in the sequence. If desired, the SKIP TOPIC command 
can produce a jump to the next program segment or subdivision which does not contain 
advertising, making it uimecessaiy for the listener to listen to advertising while scanning 
the program sequence for the next desired program segment 

The BACK command indicated at 278 operates like the SKIP command but in the 
reverse ("rewind") direction. Similarly, the BACK command may be subdivided into 
two commands, a BACK SEGMENT and a BACK SUBJECT command, which 
respectively reset the playback point to the beginning of the prior segment or the 
beginning of the prior subject description. Note that, after any given segment has played 
for a Diedetennined amount of time, the BACK command should reset the playback to be 
beginning of the current segment or topic respectively, allowing the user to start the 
current segment or topic from the beguuimg unless me playback pomt is alr^ 
beginning, in which case the transition is made to the prior segment. The system 
responds to BACK commands by resetting the playback point to the desired point in the 
sequence and recording the start time, volume setting and new program segment ID in the 
log file as indicated at 267. 

In the preferred form of the invention described in more detail in connection with 
Kg. 5, the context sensitive SKIP and BACK commands are used instead of the SKIP 
TOPIC, SKIP SUBJECT, BACK TOPIC and BACK SUBJECT commands discussed 
above. In the preferred arrangement, the program materials include subject and topic 
announcement program segments in aomn totheprognnn segmem^^om 
and advertising). When the user issues a SKIP or BACK command while the player is 
playing a subject or topic announcement, the player skips the entire subj ect or topic being 
announced and moves to the next subject or topic announcement respectively, 
autoinaticaUybypa^ 

subject or topic. 

ThemUcommahd, a'^RK" com 
mtatheusagetogwhiAide^ 

^chthelistenerwishesto dM m it8 simplest form, the bookmark 

wooding fuiuW 281 may simply record a bookmark and theProgram_ID 
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of the current program segment into log file. By bookmarking a program segment, that 
. segment may be recalled by the subscriber and all or part of it saved for later use in local 
storage, from which it may be reproduced, forwarded as an attachment to an email 
message, and the like. 

More elaborate bookmark functions which may be readily incorporated into the 
system if desired include the following: 

a. Dictating or keyboarding an annotation at a predetermined position in the 
bookmarked program segment, the annotationbeing saved in local storage so 
that, when the bookmarked program segment is reproduced, h will include the 
annotatioa The bookmarked program segment and the annotation may then 
be saved as a unit for future reference or forwarded to another person. 

b. Bookmarked program segments, or annotations to bookmarked program 
segments, may be used in conjunction as an auxiliary audio voice mail and 
email handling system in which a subscriber's email and voice mail items are 
organized as topics in the playback sessibn, enabling the subscriber to 
bookmark particular incoming messages (program segments) for further 
attention, or to dictate voice mail responses, or responses that can be 
converted to text form by a human typist or by a voice recognition system. 
This aspect of the present invention allows the subscriber to review and 
respond to incoming email and voice mail messages while commuting or 
traveling to more productively iitilize travel time. Voice annotations may be 
stored in sejprate files which are uploaded to the host with the usage file and 
keyed to the program segment passages which they annotate by records in the 

. usage log file. 

The sixth command type, the "MENU" command indicated at 283 in Fig. 3 
switches the player to a predetermined menu program segment, records the start of a 
menu mode state in the log file at 285 and places the player in the menu mode at 233; 
Using a hands free voice command system, the player may reproduce a menu program 
segment in which a sequence of options are enunciated on the system's audio output 
speaker with short pauses between the recited options. By providing the voice command 
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"Go" during or shortly aftera desired option, the user may cause the system to branch to 
that selection. Menu Options of this type may be conveniently implemented using the 
hyperlink capability described later in connection with Kg. 5. Alternatively, as noted 
earlier, the menu of options may be displayed on the screen with the desired playback 
poimbeingsdectedus^^ In aU <^ <^ h transition 

to anewprogram segment is recorded into the usage log for later uploading to the server 
and subsequent processing. 

•f 

•\ ' ■ . 

Program Compilation & BUling 

Fig. 4 illustrates the principle data processing steps and information structures 
employed by the preferred embodiment of the invention to compile programming 
information personalized to the preferences of individual subscribers, to perform 
aca>unting&ndioiis whichproduce billing charges to subscribers and advertisers, and to 
determine royalty payments due to content providers. 

Theprogram, advertising aiidaimouh^ 
mdrvidualsub^ subscriber chooses fiom 

the supplied catalog of recommended programs, or additional selections chosen during a 
dial-up dialog with the host, as described above in connection with step 2 1 7 seen in Fig 
2. The selections made by and uploaded fiom the subscriber take the form of a file 
(sequence) of 32 bh integers, each integer (ProgramID) designating a particular program 
segment. ™sffle of integers is pfc^^ 

301 in Fig. 4, with each row (record) in the Requested Table being an identification 
number which specifies a corresponding record (row) in a database table 303 called the 
Programs Table. The Requested Table 301 includes not only express requests fiom the 
user based on catalog selections but also requests which result fiom Med hyperlink 
requests which occur when the listener requested hvperlinked uiforination during the 
session which was unavailable in local storage at the player. The program segments 
(which include programs, advertising and announcements) have a plurality of attributes 
which are described in the data fields of each record (row) in the Program Table 303 
Thefofl^Pascalty^ 
Table 303: 
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Type 

Classtype = (advertisement, program, announcement); 
Program JSegment = record 

ProgramID: integer, { unique key } 

ProviderlD: integer, 

Class: Classtype; 

URL: pchar, 

Created: datetime; 

SubjectDesc: integer; 

TopicDesc; integer; 

GroupID, Episode: integer, 

CommentOn: integer; 

Subjects: array[0.. 15J of integer; 

Importance: array[0.. 15] of integer, 

Youngest, Oldest, male, female: byte; 

HouseLow, HouseHIgh: byte; 

Duration: integer; 

Plays: integer, 

TotalTime: double; 

PlaysRate, TimeRate: integer, 

Timeliness: integer, 

end; 

Each ProgramJSegment record in the Programs Table 303 is identified by a unique 
key integer value, ProgramID, which is the primary key value upon which the Programs 
Table 303 is indexed and accessed. The ProgtamJSegment records in the Programs Table 
303 are relationaily linked using the ProgramID key to other tables including: 

(a) the Requested Table 301 discussed above, 

(b) a Schedule Table .307 which contains the recommended sequence of 
program segments for the next playback session, 
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(c) a New_Catalog Table 308 which contains the identities of new available 
program selections to be added to the subscriber's catalog of available 
programming, and 

anAdverfsementsTable311 containing entries which describe advertising 
program segments to be brought to the attention of the subscriber. 



(d) 



The relational database system employed by the preferred embodiment of the 
invention further includes a Subscribers Table 3 1 3 which contains information describing 
each^bscribe^^ 

or firm which supplies royalty^earing information for dissemination to subscribers and 
an Advertiser Table 317 which contains information about each advertiser that provides 
advertising program segments to subscribers. Mailing addresses and other information 
for subscribers, content providers and advertisers is contained in a single Account Table 
321 to simplify the data structures needed. 

A Usageiog Table seen at 333 is uploaded from the subscriber, typically at the 
sametimetheexpressprogramrequestsmtte are transferred and 

processed at 350 to update the Subscribers Table 3 13, the Content Providers Table 31 5 
the Advertisements TaMe311, the Programs Table 303, and the Requested Table 301 as 
described below. ' 

Program Schedule Generation 

:• In accordance with the invention, me host server receives 
user's initial selection of a sequence of desired programs, fin* by adding the program 
selections specified in failed hypertext requests as indicated by the UsageJLog Table 333 
during usage teg processing at 350, and then by adding advertisements, announcements 
and additional program segments tailored to the subscriber's known preferences as 
"dusted at 340 in % 4, thereby producing the recommended Schedule Table 307 which 
is transferred to the subs^^ 

transfer . Indeed, if the subscriber provides no selections at aH, the host will prepare a 
Schedule Table 307 wntaming program segment sdected emirdy by me host on 
subscriber's behalf The programs, advertising and announcement segments which are 
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added to the Request Table 301 to form the Schedule Table 307 are determined by a 
matching procedure 342 which may be better understood by first considering the content 
of the data structures which provide data utilized to make those selections. 

The Programs Table 303, as noted above, contains ProgramJSegment records 
which describe the nature of each programming, advertising and announcement segment 
in the library which is pMentialry reproducible by the player 103. As illustrated by the type 
declaration above, each ProgranvSegment record specifies the. account number 
(ProviderlD) of the advertiser or content provider if any who may be charged or 
compensated for the Actual playing of Ae program segment by subscribers. The record 
further contains a Classtype variable Class which indicates whether this segment is an 
advertisement, a program, a comment or an announcement. 

The Class variable may also used to further subclass each program segment; for 
example, program segments which hold user-recorded comments may be designated as 
being "public" comments made generally available to all subscribers, "private" comments 
to be directed solely to the provider of the prOgram_segment commented upon, and 
"host" comments to be directed to the host system. 

The Program_Segment record's URL field specifies the location of the file 
containing the program segment in the file storage facility indicated at 304 in Fig. 4 0e., 
normally on the FTP server 125 seen in Fig. 1, but potentially including storage areas on 
the web server 141 or at any other accessible location oh the Internet). In addition, the 
subscriber may wish to designate for future play a program segment already loaded into 
the player 103 by virtue of a prior download. The subscriber may elect to include an 
already loaded file because it was not reached in a prior playback session or because the 
subscriber wishes replay the selection. In that event, the ProgramlD of such a selection 
is nonetheless included in the uploaded sdection fist (Requested Td>le 301), recogn^ 
that at the time of actual download, the player 103 will only request the transfer of those 
program seginerjts not already i»resent in local storage. The uploaded Requested list 301 
should accordingly be understood to be indicative of the requested content of a future 
planned playback session and not necessarily a fisting of programs to be downloaded. 
The selection of files to download is preferably made by the player which issues FTP 
download requests from the server by specifying the URUofthe needed files. 
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The Created field contains a timestamp value specifying the data and time of day 
the program segment was created. In Created field allows user or host to select program 
segments by date and permits the listing of segments in chronological order in program 
catalog listings. 

the Program_Segment record former contains a SubjectDesc field and a 
TopicDesc field, both of which take the form of PrograrnID integers which identify other 
program segment records which contain detailed information on audio announcement and 
displayable text descriptions of subjects and topics. The descriptive text files for subjects 
and topics are displayable by the player 103 as part of descriptive catalog entries which 
enable the user to choose desired segments. Together, the subject and topic program 
segments provide a hierarchical catalog listing which provides the descriptive information 
about the associated content segments which enables the subscriber to make informed 
selections. The text specified by the SubjectDesc and TopicDesc fields may be searched 
using conventional keyword searching techniques to permit the subscriber to locate and 
ideiitify particular programming of interest from the locally stored catalog or, in a dial up 
CGI interaction with the host, to list and select programs from the larger library available 
on the server. 

Serialized Programs 

As contemplated by the invention, programming may include serialized sequences 
of programs. A given program segment may represent an episode in a series which is 
selected as a group by the subscriber, or a subscriber may select an individual program in 
a serial sequence and the host may ftenfortherhistalta^ 

series to the catalog or session content thereafter sent to the subscriber. The 
Program_Segment record contains a GroupID field which specifies the series as a whole, 
and an Episode integer field specifies the position of the given program segment within 
1he serialized sequence. When a serialized sequence is requested, the host may download 
the entire series in one download for playback at requested intervals, or less than all of the 
episodes when all are not yet available or when it is desirable to limit the total download 
content. When a subscriber selects and plays a given program segment, as indicated in the 
usage log, without having expressly selecting the entire series, the host may then add the 
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next installment to the catalog or the next proposed session. If desired, a hyperlink (to 
be described) may be placed at the conclusion of each installment which specifies the next 
installment as the linked program segment. In this way, the listener may request that the 
next installment be played immediately (if it is available) or included in the next installment 
(ifit is unavailable and the hyperlink fails). . 

The usage log may be employed to insure that the subscriber has an opportunity 
to hear episodes that may have been skipped. By monitoring the usage log, if an episode 
included in any given proposed session was not in feet played, the host may include it in 
the next proposed session as well. Note further that the serialization mechanism which 
has been described can be used to provide serialized advertisements to a subscriber, 
insuring that a subscriber does not hear a particular ad twice and further insuring that the 
advertising is presented to the subscriber in the intended sequence. 

In addition, the serialization mechanism may be used to providq^sequential 
presentation relationships between related programs. For example, if a subscriber 
indicates an interest by selecting and actually playing a program on an evolving topic; for 
example, a news story about the America's Cup yacht races, further new stories on that 
topic may be assigned the same Group ID number so that they are automatically routed 
into the subscriber's catalog or program session if space is available. 

Fields supporting "Comments" 

Serialized programs are related to, but should be distinguished from, the parent- 
child relationships that exist between program segments and the annotations and 
comments made on those program segments by users. As noted earlier with respect to 
the Accept command seen at 263-264 of Fig. 3, the player 103 of Fig! 1 permits the user 
to create an "annotation" or . "comment" (typically in the form of a recorded audio 
message or a keyboarded text message) which is uploaded to the host 101 and stored as 
a program segment The CommentOn field of the Program_Segment record contains the 
ProgramJD of the program segment commented on, the Provider JD field identifies the 
subscriber generating the comment, the Created field specifies the date and time when the 
comment was recorded, and the default values of the subject matter fields (discussed 
next) are copied from the subject matter fields of the program segment being commented 
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on. These field entries provide a mechanism for supporting the comment handling 
features which are described in more detail below under the heading "Comment 
Handling." 



Program Selection 

The Program_Segment record further includes a Subjects field which is an array 
of 16 integers, each of which may be a non-zero code value indicating a predetermined 
subject matter categories, allowing each programming segment to be matched against like 
codes specified as being subjects of interest by the subscriber, as well as codes indicating 
subjects to which advertised goods and services may relate. 

The Program Jtegment record also contains an Importance field which is also an 
array of 16 integers which (at least initially) holds an integer containing the 
reviewer/editor's assessment of the "importance" of the program segment relative to the 
subject matter code specified in the corresponding cell in the Subjects array. Thus, if 
Subjecte[7] = 12345 and Importance[7]=231, this program segment has been assigned a 
importance level of 231 with respect to the subject specified by code 12345. Another 
segment may also be relevant to the same subject, but with a different level of importance 
to that subject. These fields may be used by the host as a weighting factor used to route 
programs of greater probable interest to the subscriber. Note also The "importance" value 
associated with any given program may also be adaptively altered based on the actual use 
asieftectedbytheusagelogsandbysubsm^ By way of example, 

program segments which are started but frequently skipped whflem^ 
their importance value decreased while program which are frequently selected from the 
catalog and listened to may have their importance values increased. In this way, the 
system adaptively teams, for each categoy or programs, which programs subscribers 
have found to be of interest and which ones were seldom used. Serialized programs 
(identified by a common Group ID) may be assigned importance values based on the 
actual usage of earlier episodes in the same series. Thus, when a series proves to be 
popular based on repeat selections of its episodes, all episodes (including those not yet 
issued) may be assigned a higher importance value. 
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The Youngest and Oldest fields (each storing a byte value 0-255) contains an 
indication of the age range to which a particular program segment should appeal. 
Similarly, the byte values Female and Male allow the entry of an estimate of the relative 
interest of a given program to the different sexes: thus, a program devoted to sports news 
could be assigned the values Female=60, Male=l 70 where the value 127 would indicate 
genderrneutral content. The MaritalStatus field is a single character ("S"=aingl e , 
"M'-married, "Widowed, "D"=divorced). 

ThefiddsHouseUwuidHouseHighrepresents a range of household sizes range 
that may have a special interest in the program segment, Thus, programming directed to 
family interests may be directed to subscribers, who are married with a household size 
equal to 3 or more. 

The Duration field of the Program_Segment record specifies the duration of the 
program segment expressed in seconds: the Plays field is an accumulator field which is 
incremented by inconring UsageJ^g records to reflect the total number of times a given 
program segment has been actually played by ajl subscribers. Siniilarly, the TotalTime 
value represents the total time a given program segment hw been actuaUy played by usert^ 
Together, these records can be used to determine the advertising fee due from the 
advertiser, or royalty amount payable to the content provider (the advertiser or content 
provider being specified the Provider© field) for the use of this segment. 

The PrograinSegment record contains two signed integer values, PlaysRate and 
TimeRate, permitting an advertising charge or rcydty^^ 
as a value calculated by me executable formula: 
Amount := (Plays * PlaysRate) + (TotalTime * TimeRate) 

If PlaysRate = 0, the amount of the royalty or advertising fee for actual use of the segment 
can calculated based solely on the actual tmie duration rfme played segment (so that ttttle 
credit or charge is assigned if the segment is begun but then skipped). Alternatively, if 
TimesRateFO, the charge can be based solely on the number of times playing the segment 
was commenced, which may be deemed appropriate when it may be considered the 
responsibifity of the advertiser or the content provider to hold the user's attention once 
a segment begins. Note that, as usage records are posted to increment the Plays and 
TotalTime fields in the Prbgram_Segment ^records, as described later, any program 
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segment which was played for less that a predeternuned minimum amount of time may be 
disiegard^enablmgthes^bscn^ 
, m&nnauonper segmemwimouti^^ 
fees or royalty payments. 
5 Program segments are selected for inclusion in the output Schedule Table 307 

and/or the NewCatalog Table 308 by comparing the content of the Programs Table 303 
the Subscriber Table 3^ The fields contained m 

the Subscribers and Advertisements Tables are set forth in the Mowing Pascal record 
type declarations: 

10 Account = record 

AccountNo: integer, { Unique key } 
Name, Title, CompanyName: pchar, ' 
Addri, Addr2, City: pchar, 
State: string[2]; 

Zip code, AreaCbde, Phone, Fax, Email: pchar; 

end; 



is 



Subscriber = record 

AccountNo: integer, 

Birthdate: Date • 

Sex* MaritalStatus: Char, 

HouseholdSize: byte; 

Interests: array[0..15] of integer, 

TopChoices, ChoiceCounts: array[0.:i5] of integer, 

ChargeLevel: byte; 

DataRate: Integer, 

Capacity: Integer, 

WeekDays: array[0..6] of Compilation; 
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Advertisement = record 
ProgramID: integer; 
AccountNo: integer; 
DemographicMatch: functioned; 
DemographicWeight: byte; 
Earliest, Latest: datetime; 
Subscribers: integer, 
Repeats: byte; 
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end; 

The Accounts Table seen at 321in Fig. 4 is indexed by a key value AccountNo 
which is unique to each of its Account records. The fields of those records contain name, 
mailing address, telephone, fax and email information for all subscribers, advertisers and 
content providers in a single shared file. A person or firm specified by a record in the 
Accounts Table could simultaneously be a subscriber, advertiser and a content provider, 
in which case the same AccountNo key value would appear in each of the three tables: 
Subscribers 3 13, Content Providers 3 15 and Advertisers 3 17. Prospective or inactive 
subscribers, content providers and advertisers may also be described by entries in the 
Accounts Table which are not referred to in any other tables. 

Additional information about each active subscriber is contained in the Subscriber 
record indexed by AccountNo (a key snared with the Accounts Table). The Subscriber 
record specifies personal information about the subscriber, including birth- date (from 
which age may be determined), sex, marital status, and household size, all of which may 
be ofuse in better sele^ing program material of possible interest which should be brought 
to the attention of the subscriber. 

Each Subscriber record further includes two arrays of integers which indicated the 
subscriber' s subject matter preferences. The Interests array contains 0 to 16 integers each 
indicating a subject matter category of interest to the subscriber, the integers having the 
same meaning and being take from the same category listing as the integers placed in the 
Program_Segment record's Subject array. These integers are placed in the Interests array 
in response to the subscriber's indication of subject matter preferences when the account 
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is established as indicated at 203 in Fig. 2 or at any time thereafter when the subscriber 
elects to modify the stated preferences at step 217 in Fig. 2. 

A second array of 16 integers called TopChoices is an ordered fast of the same 
subject matter integers; however, in this array the subject matter integers are listed in 
5 order of actual playing frequency as indicated by the parallel array of ChoiceCounts 
integers. For example, the subject matter integer 321 in TopChoicesp] and the count 18 
in ChoiceCounts[3] indicates that 18 selections had been played in the category 321 which 
was the fourth most-frequently played category. The ChoiceCounts array is modified 
whenever the usage log indicates that a selection in aparticular category has been played 
10 by that subscriber. As a consequence, the TopChoices and ChoiceCounts arrays provide 
an indication of the subscriber' s interests as indicated by his or her actual use of the 
player. 

The ChargeLevel field in the Subscriber record indicates the subscriber's 
willingness to accept the insertion of commercial messages into 
15 to defiay subscription costs. A ChargeLevel value of zero indicates that the subscriber 
desires to pay the minimum charge and coirespondingly is willing to accept sufficient 
advertising content to achieve that goal. At the other extreme, a ChargeLevel value of 
255 indicates that the subscriber wishes to eliminate all commercial messages except those 
specifically requested. 

20 The DataRate field indicates the rate at whicJiiiiformation can be downloaded to 

the subscriber over ^ available conim^ 

of the modem used by the subscriber). The DataRate field is initially established from 
information supplied by the subscriber when the account is established (at step 203 in Fig. 
2) but is thereafter altered to reflect acwal avwaged traiisiri^ 

25 download operations. Similarly, the Capacity field indicates the available inass storage file 
space available for program data in the player store (seen at 109 in Fig. 1). This value is 
initially supplied by the subscriber during accoum initializati^^ 
whenever the utility programs executing oh the processor 105 detect less space available, 
and increased whenever the subscriber consents to the allocation of more available space 

30 ^tottiiityprogriuMdet^ 
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beneficially utilized given the download time available and the subscriber's desired session 
lengths. " 

Desired session lengths are contained in seven records each of type Compilation 
as defined in the following record definition: 

Compilation -record 

Earliest, Latest: datetime; 

PlayMinutes, Longtenn: Integer; 
end; 

Each Compilation record describes the download requirements fi>r a specific day 
of the week and contains fields specifying the earliest and latest times of day when 
download can be begun, with the latest download time being at least a predetermined time 
in advance of the session start. In tins regard, it should be noted that playback and 
download can occur concurrently, with the Schedule Table being downloaded first, the 
NewCataiog Table being downloaded second, program segments specified in the Schedule 
Table which have not previously been downloaded being transferred third (in the order of 
the expected presentation as stated in the Sequence Table), with program segments 
selected by the subscriber tor future sessions being downloaded last as download time 
permits. In accordance with the invention, it is desirable to download the equivalent of 
a full session's prograniming in addition to the currently scheduled session programs so 
that, in the event of a temporary communication link or host fiulure, programming will be 
nonetheless be available: In installations which utilize download information to a 
removable media cartridge or a transportable player which is then played back in an 
automobile or elsewhere, and hence disconnected from the data link to the host, it will of 
course be necessary to complete the download prior to the disconnection, meaning that 
the Latest field in the compilation record should be a time which is in advance of the 
earliest expected session start time by a duration equal to the maximum expected 
download time. Because the subscriber may wish to use different download timing on 
different days of the week, a separate compilation record exists for each day. 
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The compilation record fiirther specifies the expected duration of the playback 
session for that day using the variable PlayMinutes, The variable Longterm indicates the 
maximum duration in which extended play may be required. For example, a commuter 
who sometimes experiences long traffic delays on Mondays and Fridays may specify that 
an extra hour of extended programming should be provided for those days. Such 
extended prograirui^ispref^ 
be stored for fixture use as needed by the player. 

Notetrmtthecompilationrecords noted above are used by the sender to optimize 
the content of the recommended program schedule and not to initiate actual downloads 
to the player. As contemplated by the invention, the player initiates the actual downloads 
bysendir^downloadrequeststotheserver^ Nonetheless, the server can transmit to the 
client player an indication of optimum times when downloading should be requested. In 
this way, the load imposed on the server can be spread over time to avoid delays. 

Program segments which are of interest to the user and which should be included 
»^the Schedule Table307o^^ 
by the Mowing mechanisms: . 

a. the subject matter codes (Intei^ To^ 
given subscriber for whom the S(^ule Table 307 
being prepared may be compared with the subject matter contained in the 
ProgramJ5egmemre^^ 

eaAmdMduali^gramd Note that the Program_Segment record 

- ^subject category d 

an indication that a subscriber is interested m a partial 

used to identify that category, any related category, and any program winch 

specifies that category in its Progim_Segmem record. A wdghting value 

may be calculated to indicate the extent to wMch the subs<^er's stated 

mterestsinatchagivehpro 

high weighting values are assigned are pl«^ m the Schedule Table if 
usage log data does not indicate the subscriber has already played that 
; program, whereas the reina^ 

than a predetermined threshold are placed in the Catalog Table 308. The 
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duration of the programs specified in the Schedule file 307 is governed by the 
scheduled session lengths, communications throughput* and client storage 
capacity values contained in the DataRate, Capacity and WeekDays fields of 
the Subscriber record., 
b. The attributes of the subscriber (birthdate, sex, marital status, and household 
size) specified in the Subscriber record may be matched against the 
corresponding descriptions contained in the subject and program 
Program_Segment records (youngest, oldest, male, female, houselow, 
hpusehigh) to identify programs and categories of programs likely to be of 
interest to a subscriber having those attributes. An advertiser-supplied 
function defining this relationship is specified by the DemographicMatch 
functioned field of the Advertiser record, as discussed below. 

a. The host server may advantageously use an optimization technique such 
as linear prograniming to complete the segment selection process. The 
optimizer will take into account the Subscriber's time constraints, cost 
constraints, and subject preferences. The time constraints used in the 
optimization are: the playing time available for the current day at the 
player, the download time available, the percentage of segments usually 
skipped by the Subscriber. The cost constraints are Subscriber 
GhargeLevel and the accumulated value of individual advertising 
segments. The subject preferences are based on the user's expressly stated 

. . interests and others interests inferred from the user's playing selections, as 
noted earlier. Each segment resident in the database at the time of 
download is evaluated against the constraints and the optimizer thus 
chooses a set of segments which is best for the subscriber at that time. 

b. The weighting value computed for a segment in the database may also be 
advantageously varied in accordance with the age of the segment; that is, . 
segments will decline in value as they age with the rate of decline being 
depend on the Timeliness attribute stored in the Frogram_Segment record. 
If the subscriber misses a download for a given day, the timeliness factor 
will allow the host server to compensate fi>r the lost listening opportunity 
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by adding articles from prior days which are still of interest to the 
Subscriber. 



Targeted Advertising 

In order to identify and insert advertising program segments into the Schedule 
5 Table 307, the preferred embodiment of the invention utilizes additional information which 
describes each advertisement to be placed before subscribers. This information is placed 
in an Advertisement record having the structure defined earlier and held in the 
Advertisements Table311. The Program© field of the Advertisement record identifies 
a Program_Segment record (described earlier) which describes the content of the 
10 advertisement itself The remainder of the Advertisement record contains additional 
information used to control the manner in which the identified advertising program 
segment is selected for insertion into the prograjnming supplied to subscribers. 

The AccountNo field of the Advertisement record identifies the entity requesting 
the advertisement which is typically the same as, but not necessarily the same as, the entity 
specified in the Provider© field of the PiogramJSegment record for advertising segment. 
, The Subjects and Importance arrays in the program segment for the advertising (specified 
by the ProgramID field) may be matched me subject num^ categories used by or c^ 
for subscribers to indicate their interest and may be used to produce a numerical value 
InterestMatch indicative of the extern to which a grvenadverus^^ 
to the interests of a particular subscriber. The following algorithm, expressed as a 
.fimction in Pascal, .rjetorns an integer value, which may be employed to derive the 
InterestMatch value indicating the degree to which any program segment matches the 
interests' of a given subscriber: 

fijnction InterestMatch(SR: subscriber; PSR: programjegment): integer, 
25 - var I: integer, 

IhterestCount: integer, 
ChoiceCount: integer, 



15 



20 



InterestCount:=0; 
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ChoiceCount:=0; 
forl:=0to 15 do 
if PSR.subjects[I] > 0 then 
, forj:=Oto 15 do. 
begin 

if SRInterestsD] = PSR;Subject8[I] then 

inc(IhterestCount,PSR.Iinportance[I]); 
if SR.TopChoicesO] = PSR.Subjects[T| then 

inc(Choice!Ck)unt8X20-j)*PSRIinport?uice{I]); 

end 
else break; 

returndnterestCount + (ChoiceCounts div 10); 
end; { InterestMatch function } 

The foregoing function identifies all of the Subjects codes specified by the 
program_segment record for a program segment (including a segment specified the 
ProgramID value of the Advertisement record for that advertisement) which also match 
a subject matter code in which the subscriber described by the Subscriber record SR has 
expressly stated an interest, or has shown an interest base on programs actually played. 
In each case where a match was found, the Interest_Match value is increased by an 
amount related to both the weight given to the category in advertising program's 
Importance array and the level of interest indicated for the subscriber. Note the 
InterestMatch function described above can be used to generate a numerical indication of 
the degree to which a given subscriber may have an interest in any program segment, 
whether that segment contains advertising, entertainment, news, or In the 

case of advertising program segment however, the Subject and Importance values are 
assigned by the advertiser in order to define the interests held by target subscriber to 
whom the advertiser wished to direct the advertisement. 

In addition to the InterestMatch value determined above, weight may be given to 
the subscriber's personal characteristics using a similar weighting function specified th the 
functioned DemographicMatch which, like interest match, returns a value based on an 
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advertiser specifed relationship based on the subscriber's personal characteristics (age, 
sex, marital status, size of household, etc.) as previously noted. The value 
DemographicWeight may be used to specify the relative importance of demographic 
values derived by the the DemographicMatch function and the value returned by 
InterestMatch. 

All advertisements scheduled for a given subscriber may then be prioritized based 
on the resulting calculated weight assigned to each advertisement by matching algorithms 
which compare the characteristics of the subscriber with the makeup of the target 
audience defined by the Adds of the Advertisement record, these advertisements are then 
preferably inserted into the programming Sequence with the advertisement having the 
highest weight being scheduled to occur first in the sequence, thereby insuring that the 
best fitting advertisements are included in the programming and most likely to be played 
by the subscriber. 

Controlling the Quantity of Advertising Delivered 

The rate at which advertising is actually inserted by the player is controlled by the 
ChargeLevd value in the Subscriber record for each subscriber. The ChargeLevel value 
(a number from 0*255) indicates the rate at which a subscriber is willing to accept 
advertisements. An advertisement duration count variable (not shown) maintained by the 
player 103 accumulates the total duration of actually played advertising while a program 
duration count variable accumulates the total duration of actually played programming. 
An integer division of these to duration count values indicates the proportion of time 
being devoted to advertising. If this proportion falls below a threshold value determined 
by the value of ChargeLevel, additional advertising is inserted between program segments 
until the desired proportion is again reached. In this way, advertising skipped by a 
subscriber will be replaced later by different advertising to yield the proper proportion of 
programming to advertising, thereby achieving the subscription charge rate requested by 
the user. 

The Schedule 307 downloaded to the player; and the associated programming, 
announcement and advertising segments sufficient to provide a complete program 
sequence with adequate advertising to meet the preference of the subscriber, creates total 
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program content longer than the expected playing time indicated by the PlayMinutes 
variable of the days Compilation record. As a consequence, the player builds a collection 
of program and advertising segments which can be played in the future and need not be 
downloaded. Downloading of actual program segments therefore preferably occurs at the 
request of the player which scans the Schedule for program and advertising segments not 
already available and issues a request for the needed segments using the URLs contained 
in the players catalog of ProgramJSegment records. In addition, as noted earlier, the 
subscriber has the opportunity to review the local catalog for particular program segments 
of interest which can be placed in the next day's schedule (and downloaded then at the 
request of the player if not already resident). The catalog of available items is 
supplemented by the NewCatalog Table Hems downloaded from the server as library items 
are identified whose makeup matches that of the subscriber and should be included, either 
inimediately in the days Schedule Table, or made available by inclusion in the downloaded 
NewCatalog Table alone. 

Accounting Functions 

The preferred embodiment of the invention processes the usage log data created 
during the playback session as described in connection with Fig. 3 to produce a variety of 
accounting and analysis reports and billing fiinctions 

Each advertising, announcement and program segment played on the player 
creates a UsageRecord stored as an record in the Usage Log Table having the following 
content: 

UsageRecord = record 

Subscriber: integer; 
ProgramID: integer, 
Start: datetime; 
Volume: Integer; . 
PlayingSpeed: Integer, 

end; 



41 



WO 99/43111 v 

PCT/US98/03444 

The Subscriber field contains the AccountNo of the subscriber which used the 
program segment, and the program segment itself is identified by the Program© field 
If the value ofProgramlD is negative, the record indicates a foiled hyperlink attempt and 
theProgramID is posted to theRequested Table301 so that the formerly missing program 
segmemvviDbecomeamddatefordowitfo In the UsageRecord, the 

Start field contains the starting time of day (to the nearest second), the Volume field 
contains a value indicating the level at which the volume was played, and the 
PlayingSpeed field contains a value indicating the playing speed. A negative playing speed 
value may be used to indicate that the player was placed in the "play highlights" mode so 
that only highlight passages were being played! 

As notedearfier, each UsageRecord is processed to modify the Subscriber record 
field TopChoices by first building an ordered list of subject matter categories and the 
corresponding counts of the number of times each category was played in the session 
described by the Usage Log Table. These counts are then used to increase the existing 
Choice Counts for the subject matter codes indicated in the TopChoices array, and the 
TopChoices and ChoiceCounts arrays are then jointly resorted into order by descending 
numberofplays. To insure that subject matter categories recendy used are aUowed entry 
into the list, the lowest five old entries are discarded each time if necessary to make room 
for the five most frequently played categories in the current usage log which were not 
alreadyonthelist TheTo^hoicesan^y 

of subscriber subject matter preferences which is continuously modified automatically 
without quiring attention from the subscriber. 

Subscriber billing is based on the accumulated mourn of program 
Playedby the subscriber with credit being grvea for advertisk^ 
subscriber. To accomplish this, a detailed billing history can be constructed from the 
usage log which indicates the programs heard, the duration of each, and the cost (or 
credit) attributable to that program segment, the TimeRate value specified in the 
Programjiegment record for each Hern specified in the UsageRecord's ProgramID is 
multipHed times the segment duration (determined by subtracting the start time of the 
S(^frommestartmiieofmenextsegmentsp ^ 
TimeRate is a signed integer, with negative values being indicative of credits (for 
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advertising) and positive values being indicative of charges for programming. Note that 
each program segment and advertising segment can have a different rate, allowing the 
system to accommodate charging rates that reflect different programming costs. 

Such costs frequently are affected by the royalty rates charged by content 
providers as well as the extent to which costs are defrayed by advertisers. In accordance 
with the invention, each UsageRecbrd may also be posted into the Content Providers 
Table 315 which maintains royalty payment records for amounts due to content providers. 
As in the case of subscriber billing, the processing of UsageRecdrds allows the 
embodiment shown in Fig. 4 to provide detailed information to content providers, 
iderrthying the extent each provided program segment was actually performed. Content 
providers can also be provided with demographic statistics identifying the characteristics 
of the subscribers who chose to play the content provided, as well as an identification of 
the extent to which program segments were skipped while in progress, tending to identify 
programs which were had continuing appeal during the session and those that did not. 

Similarly, advertisers can obtain detailed billing records mdicating the precise 
extent to which advertising was actually presented, and paying only for advertising known 
to have been effectively dehvered. Li addition, demographic data can be provided to 
advertisers indicating the makeup of persons who played the advertising, as well as the 
demographic characteristics of those who did not, in order to better target future 
advertising. 

FiiiaJry, the UsageRecords are processed 
modifying the Plays and TotalTime fields of the Program Segment records to reflect the 
extent to which programming materials are actually presented. This information, as well 
as the demographic statistical information indicating which classes of customers are 
listening to which classes of programming, is of substantial value in collecting a library of 
offered prograiniiiing which best fits the needs of the community of subscribers. 

Program Format and Organization 

The programs which reside in the program database 303 seen in Fig. 4 are 
preferably formatted in accordance with a standard structure to facilitate "skimming" the 
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sequence of program segments defined by the selections file 351, and to make H possible 
to perforin jumps to different, pi^etennined locations in the program sequence. 

As previously noted, the program database 3 03 mayinclude, for a given program 
segment, bomarecortledaudionairauon^ atext 
transcript alone which can be converted into a spoken narrative by speech synthesis 
Whfle these narratives must be listened to in a linear sequence, it is nonetheless possible 
to selectively access individual program segments by organizing the overall program 
compilation into a hierarchical structure in which: - 

1. As noted earlier, the program segments wMA are available ma master 

are described in a catalog and associated with descriptors of various kinds 
aUc^fhewmemofthecoiiv 

subscriber, both through express selections ! made by me subscriber and by 
selections (or suggestions) made automatically by matching the subscribers 
known preferences and interests against descriptors which characterize the 
programs segments, as previously described. 

2. The resulting program compilation is then divided into components each 
liavingaoeghmir^ 

by a dynamic selection mechanism which is operative during the fastening 
session. 

3. Agrven program segiiua^ 

selected autdmaticaUy or expressly by the user as being of interest as 
previously described) is a*nintageously combme^ 

segments to form a sequence of associated segments here called a "subject," 
fanning a subsection of the overall compilation. A "subject" collection of 
program segments may (but need not) dkec% correspond to me iiamed 
subject matter categories utilized to specify subscriber's preferences as noted 
earlier. A "subject" collection begins with or is preceded in the scheduled 
program sequence by a spoken aimoun^em of the subject, givmg the user 
the opportunity to skip immediately to the next subject, thereby skipping all 
of the program segments comprising that subject. 
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As a consequence, by the simple expedient of skipping from subject 
announcement to subject announcement, a user can locate a particular subject 
of interest. For example, if a given program compilation as defined by the 
Selections file (having the format illustrated at 351 in Fig. 5) contains one hour 
of programrning divided into 8 different subjects collections, the user can 
quickly locate a subject of interest by skipping from subject announcement to 
subject announcement until a subject of interest is announced, at which time 
the player is allowed to proceed to the next level in the hierarchy, a "topic" 
announcement for the first program segment in that subject collection. 

4. Each program segment begins with a "topic" announcement which consists of 
a brief,, summary description of.the content of the program segment to follow. 
Again, at this level, if the user upon hearing the topic announcement elects to 
skip that program segment, the player automatically advances to the entry 
point preceding the next topic announcement. In this way, within a given 
subject, the user can skip from topic to topic to select only the program 
segments of interest. 

5. Following the topic announcement, if the program segment consists of 
narrative text, such as a news program, the narrative is presented in a 
sequence of paragraphs, with the first paragraph providing an overview 
summary of the content of the program segment (topic) and the succeeding 
paragraphs providing increasing levels of detail. The narrative is thus 
presented in a fashion not unlike that followed in news stories written by 
journalists for print publication, but with more dependable rigor, recognizing 

. that the listener presented with a one-dimensional audio presentation must 
necessarily depend on the consistent adherence to the subject, topic, summary 
paragraph, and increasing detail sequence to substitute for the random access 
provided by two-dimensional presentation of headlined newsprint articles. 

6. Finally, within paragraphs, the sentences should be carefully organized with 
leading topic sentences, again giving the listener a preview of what is corning 
next in the sequence to enable that material to be skipped if it is hot of interest. 
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By way of example, a program compilation for a given subscriber might 
illustratively consist of seven subjects: world news, national news, local news, computer 
trade news, email and voice mail messages, country music, classical music, and the listener 
may skip from subject announcement to subject announcement to readily locate the 
beginiung of any one of the six subjects. The four "news" subjects each consist of a 
collection of structured program segments, each of which begins with a subject 
announcement, again allowing the user to skip from subject to subject, listening to only 
.those which are found to be of interest. 

Similarly, the music selections ("topics") within each of the two music subjects, 
"country music" and "classical muffle," are preceded with a brief announcement identifying 
the musical selection which follows, allowing the user to quickly skip from announcement 
to announcement until a desired selection is found. Because many listeners prefer music 
without announcements, the subscriber may request that the announcements be suppressed 
during continuous play and/or that the beginning of each musical segment be played 
instead of identifying announcements when the musical collection is being "skimmed" to 
locate the next selection to be played. To simplify the player controls, the subscriber is 
preferably selects the extent to which narrative music identification announcements are to 
be played at step 21 1 seen in Fig. 2, at the same time the user is given the opportunity to 
edit the downloaded program sequence. 

Play Highlights Mode 

To further facilitate rapid skimming, the player may be adapted to support 
playback in what is here termed the "play highlights" mode. Just as a student often uses 
a marker to highlight important names and phrases in printed text, key points in the audio 
Mrtttrvemay be tagged as highlights such that, when the user places the player in a "play 
highlights" mode, the player automatic^ skips fhjm highnghted passage to nignligta 
passage, greatly increasing the speed of presentation, but allowing the user to revert to 
normally play mode whenever a highlighted passage attracts the users interest for more 
detail. 

Highlighted passages may be advantageously identified by means of a sequence 
relative byte locations (integer oftsets from the beginning of the program segment) which 
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form part of the selections file 35 1 and which specify the start and end of each highlighted 
passage. The player, when placed in the "play highlights" mode, then plays only those 
passages identified as highlighted portions of the program segment file. 

Hyperlink Jumps 

In addition, the structured program files , may advantageously contain, where 
appropriate, "hyperlink" passages, which may take the form of announced cross references 
to other materials, or sentences or phrases which describe related information contained 
- elsewhere in the download compilation but which do not follow immediately in the 
sequence. In order to alert the listener to the fact that a sentence or passage is a hyperlink 
to other information which is out of the normal playback sequence, an audible cue may 
advantageously proceed, accompany, or immediately follow the passage in the normal 
playback which identifies the character of the hyperlinked material. Using the 
terminology typically employed to described hypertext, the normal programming 
sequence includes "anchor" passages which are identified by an audible cue signal of some 
type and are further associated with a reference to hyperlinked material to which the 
playback may jump upon the listener's request. Hyperlinked material, like all other 
programming, is advantageously preceded with a topic description and, if the hyperlinked 
material is a narrative, it should begin with a summary paragraph, followed by increasing 
detail. - 

A hyperlink may be directed to a program segment which is not present in the 
current selections list. In that case, the Link variable contains a negative number to 
distinguish it from references to a particular Selection_Record, and is interpreted as the 
negative of a ProgramID number. If the referenced ProgramID is available in the player's 
mass storage system, it may be fetched an played and, upon its conclusion, an automatic 
return is made to the original sequence. If the referenced ProgramID does not refer to a 
locally stored record, the listener is informed that it is currently unavailable, but will be 
included in the next download for the next session. 

In addition to having means for accepting a user command to execute a jump to 
the hypertext material, the player also advantageously includes a mechanism (special key 
or voice command response) which, when activated, causes a "return" to be made to the 
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playing sequence at the point of the original anchor from which the hyperlink was 
performed. In this way, a listener may listen, to as much or as little of the linked 
information as desired, retaining the ability to return to the original. Just as computer 
subroutines may be nested by saving the return addresses of a calling instruction in a stack 
mechanism, ahyperlinkmay be executed from withto ah 

with the listener retiiming the ability to execute a like sequence of returns to resume the 
playing sequence at the point of the first hyperlink call 

To control subject and topic skipping, as well as hyperlink jumps, the selections 
ffle seen generaJry at 301 m Kg. 4 preferab 

having the structure defined by the following Pascal record definition: 

type Selection_Record = record 
LocType: Char; 
Location: Integer; 

end; 

where LocType is a single byte character havii« me vahies and me* 
following table: 



LocTypff 


Meaning 


"S'VV* 


Subject Announcement 




Topic Announcement 




Programming content segment 




Advertising segment 


"C^g" 


Glue (announcement) segment 


"St 


Highlight start oflfeet 


«E» 


Highlight end offset 


"A" 


Anchor start offeet 


"M" 


Bookmarked anchor start 




Anchor end offset 


"L" 


Linked segment 




Rewind to identified location 




Image identification 


u r 


Image display start offiset 
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"K" Image display end offset 

"C" Accept comment 

"V" Accept value designation 

"X" Accept list termination 

"Y" Accept "Yes" /"No" 



As seen in the table, highlight passages are specified by two SdectiohRecords, 
an «H" marking the beginning and an "E" record marking the end of the highlight passage. 
The Location field in each record contains the byte offset from the beginning of the 
current program segment whose identity is specified by the last preceding "P" 
Selection_Record which contains the Program© of the program segment in which the 
highlight passage occurs. "Q" advertising segments and *G" announcements segments 
behave like regular programming content segments, but are uniquely identified to enable 
the player to skip over, or skip to, advertising and glue segments when appropriate. In 
the "play highlights" mode, the player scans the selections file and plays the program 
segments for each subject and topic announcements but plays only those portions of an 
identified program segment which are specified as highlight passages or as anchor 
passages for hyperlinks.. 

It is desirable to further provide a mechanism for subdividing narrative 
programming segments into subparts (e.g. paragraphs). Lowercase LocType values "s", 
"T, "p", "q" and "g" are used to subdivide subjects, topics, programming, advertising and 
glue segments respectively. The lowercase Loctype records provide the markers needed 
to implement subdivision skipping, as previously discussed, to enable forward and 
backward navigation within longer program segments, and further provides passage 
identifiers which may be used to better synchronize the audio and visual transcript 
presentation of longer passages. 

An T Selection_Record contains an integer identification of an image file which 
is downloaded and stored using a filename found in an image filename table indexed by 
the image identification number. This indirect access to the image files eliminates the 
necessity of storing the. filenames themselves in.the selections file 351. The "I" image file 
identification record iinmedia^ a V record which specifies the offset location 
from the start of the compressed audio file where, the image display begins. In normal 
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turned off for those instances when it is desired to suppress the image display entirely 

Each^orpa^efbrahypeM^ 
record indicating the start of the anchor passage, an <«B» record indicating the end of the 

to which a jump is made if the user requests > jump to the hyperlinked material. 

As discussed in more detail later in connection wimF lg . 7 of the oawings, the 
position and identification of highlighted passages, hypertext links and synchronized 
M^m***mk*,, expressedusing conventional hypertext markup language to 
tag the text of the narrative to being presented in the interactive multimedia format 
contemplated by this aspect of the invention. 

The start of bookmarked i^bWWwII,,^^^ 
Vfollowedbya^recordto identify me end of me boolonarked passage. If a voice 
annotation is added, the player places it in its own program segment which is identified 
^m^no^^n^V-^ Thepresenceoftheannotatioh 
may then be made known to the listener during subsequent playback of the marked 
passagebymeans of adistinctive audible cue, and the annotation may then be listened to 
ntomn^umy^aA**^^,^ Note that bookmarked 
passages and annotations are noted both in the usage log file, as discussed earlier in 
connection with Kg.3 at 280 and 281; but also their presence is also recorded in the 
SelectionsfileSSl by inserting «M»,«B«, and C tf annotations exist) «L» records maldng 
it possible to immediately replay annotations or return to replay bookmarked passages 
Annotations differ from "comments" like an annotation, a comment is also 
stored in its own program segment, but a comment operates as a public or private 
iiusssa^generated by theuser and communicated pubUcly or privatdy to 
specimen* group, (2) the originator of a program segment, which may be the author 
ofeaAertfcmmen^^ 

ancnefbrfin^referenw. ^Mcon^^^^^^^ 
request of the user at any point during a playing program segmem using the ^Accepf' 
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command (see 263-264 in Fig. 3), the user may be prompted by a pre-recorded request 
for a comment, or other user input, with the prompting request being placed at any point 
in a playing program segment, typically after an audio prompt which explains the nature 
of the information being requested. 

Requests for information from the user preferably take one of three forms which 
are implemented by the records in the schedule file identified by the LocType codes "C" 
,<*V","X" and"Y". 

A "C" record causes the player to temporarily pause the playback and record a 
voice response from the user which may be aitttraruy long and which is uploaded to the 
server 101 to form a new program segment in the manner to be described under the 
heading "Comment Handling. 

A "Y" record pauses the playback and awaits a ? Yes* or "No" response from the 
user which is then recorded in the usage teg. The yes/no response request allows a 
program provider to obtain response data from subscribers! 

When simple "yes" / "no" answers are inadequate, a series of «V records may be 
used to identify a set of prompt values from which the user may select, with the end of the 
list being indicated by a "X" record. The narrative of a program segment might, for 
example, proceed as follows: " We would like to know which of the following four ice 
cream flavors is your favorite. Say the word "YES" promptly when your favorite is 
mentioned. Y chocolate Y vanilla Y pistachio Y peach E". In the tsxample, the Y 
characters indicate the position of the start of each prompted choice and the E character 
indicates the end. If no affirmative voice response has been accepted by the time in the 
playback the position indicated by the E selection record, the player returns to the 
positions indicated by first of the series of Y records to repeat the choices. When a valid 
response is received, a response value is written into the usage log indicating the ordinal 
position of the selected response. Given the prompts above, for example, if the user says 
"YES" after the "chocolate" prompt, the response value 1 is written to the usage log, if 
the user selects 'vanilla' a 2 is written, and so on. 
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The Selections File 

register Currently seen „ 353 which JeMn| ^ rf ^ par&uiar 

■*- h ^«-k»»"l-i-«.351»h^i - i t Aa .hown, Currently 

^■#««-hl*«( identified^ iheloCyp, + 3SS 

w ^ c * 1 contains the ProgramlD of an announcemeitt program segment which 
, desc^thesubject. Kto u^taes.s^ce^ during orshorUyate^.^ 
wh« subject «™~«emen. is phyed, the phyer execute, . *b *, * .^f^ 
who* ■ accompEsbed by seaming fc ^ ^ „, ^ ^ ^ 
Selecaon.IUcord see. at 360 . toMtt d, and then performing . jump by taserdng me 
locate, of SeierfonKecord 360 into 4. CuremMay regiaer 353, causu* me 
mtervening materia] to be skipped as indicated by the dashed hoe 362. 

If, instead, no subject skip is requated, the CtoentPi^ register is increnKntrf by 

Locationfleld of record 364. ». ^ is reque^ during or abort!, after the time when 
•V. aanouncemem specified byrecord 364 Uplayed, mer^sc^m. Section ffle 
3S5 — •.-* T «T Se^jUcordisfeWrtJeo, ciusing toioteVM . 
program to be dipped and the topic ^UHHrncemew^ed by record 366 tt 

of the kst program subject within the current subject couection and pl^ the nea "S» 

a de-red program segment, no matter where it is located with respect to the current 
selection, can be readily found. 

fftow ^'^<=o»«»indduri 1 ^ 
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the next "S" subject or *T ? topic record, skipping the remainder of the program selection. 
Thus, the user can quickly resume skimming on the subject and topic level at any time. 

The user may also issue a "Back'* command at any time. Back commands work 
like Skip commands at the subdivision, subject and topic level. If a Back command is 
issued when a subject is being played, the player scans backward to the previous subject 
announcement, which is then played. If the user issues a back command when a topic 
announcement is being played, the player scans backward to find the previous subject or 
topic announcement, which is then played. If the player issues a Back command during 
the playing of a programming segment, the player returns to the beginning of the prior 
subdivision (if any) or the prior topic announcement for the current program segment, 
thus enabling the user to easily "replay" a current segment from the beginning if desired. 
As in the case of forVrard skip commands (SKIP TOPIC and a SKIP SUBJECT), BACK 
TOPIC and BACK SUBJECT commands can be made available to the user such that 
backward navigation from subdivision to subdivision occurs using BACK TOPIC whereas 
the issuance of a BACK SUBJECT command always returns the playback point to the 
beginning of the prior subject matter description. 

The manna- in which a "Back" command is handled as described above is subject 
on additional variation: The position at which each skip forward command is issued may 
be advantageously saved so that, upon the issuance of a subsequent Back command, the 
user may return to the position at which the skip forward position was issued. This allows 
the user, for example, to skip forward to listen to the nest program announcement, and 
then use the Back command to return to the point from which the skip forward command 
was issued. These position indications may be saved as markers in a bi-directional list, 
allowing the user to skip forward or backward to any position from which a prior jump 
was made. 

When the player is first activated, CurrentPlay is set to 1 to begin play with the 
first topic announcement specified by the ProgramlD 357. The end of the selections file 
351 is marked with an "R" SdectiohJRecord 380 which contains the location value 1. 
When the player encounters this record, it resets the CurrentPlay register to 1, and the 
playing sequence begins again. This arrangement creates, in effect, an endless loop, 
allowing the user to skip forward in circular fashion through the entire program selection 
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to locate desired programming, regardless of where the CurrentPlay register is set. When 
the player is given a further back command after the beginning of the file is reached, the 
backward scanning process finds the record 382, another "R* rewind record which 
contains the location of the last "S" subject Selection_Record. In this way, the selection 
s file 351 behaves as a bi-directional endless loop. 

Hyperlinks are implemented by means of anchor passage identifiers, the "A" and 
**B" Selection records which respectively identify the anchor passage, and a "L" link 
identifier which hblds the location of a subject, topic or UghKghtSelectionJLecord. The 
"A"'and "B" selection records enable the player to add an audio cue (such as a tone, low- 

10 level chime, or the like) to me beginning, end, or during any passage in any program 
selection. Whenever the user issues a "Go" command (seen at 265 in Fig. 3), the player 
witt execute a hyperlink jump to the location indicated by the last "L" record in the 
selection file. When the jump is made, the locationin the T» record is inserted into the 
CurrentPlay register 353 after the previous contents of the CurrentPlay register are saved 

15 in (pushed into) a 2ero4)ased stack 390 at the stack oell locati^ 

of a StackPtr register 392, which is then incremented. Whenever the listener issues a 
"Return" command, the previously pushed selection file record location is popped from 
the stack 390 and returned to the CurrentPlay register 353, and the StackPtr register 392 
^decremented. A *Tletiim"coiimiand issued whenStackPtr«w OMcating an empty 

2Q stack) produces no effect. 

The hyperlink capability described above may be used to implement a program 
menu of the type described earlier in coimei^nwim Fig. 3: A mem program segment 
may be included in the program coinpilation whiA includes a series of spok^ 
of subjects or topics, each description being the anchor portion of a hypeiiink to the 

25 corresponding subject or topic.' 

Although hypertinks to subjects and topics are typical, it should be noted that the 
arrangement shown in Fig. 5 can be used to link any passage to the beginning or end of 
any highlighted passage or to the beginning or end of any anchor passage simply by 
placing the selection file location of that target fo toe ^" link Sdectioh^^ 

30 that link. 



54 



WO 99/431 1J 



PCT/US98/03444 



In its preferred form, the individual program segments are stored in a random 
access mass storage system permitting program segments tp be physically stored in an 
order unrelated to the actual dynamic sequence in which those segments are played. 
Forward, and backward skimming, highlight playing, and hypertext jumps can accordingly 
be implemented without any noticeable delay being apparent to the user, unlike the delays 
which are experienced in forward and rewind operations on aphysical tape player, or even 
the briefer delays experienced upon selecting a different track of a compact disk music 
album. ... • 

As contemplated by the invention, the -integration of structured audio 
announcements and content, as will as cross-referencing and indexing information in the 
audio program compilation, allows the player to be much more interactive than a simple 
tape recorder. The user has the ability to browse and skip through the audio program in 
a very active way, without any requirement to look at a visible display of the program 
content. The ability to navigate the program using only audio prompts and/or small 
number of buttons for a user interlace make the playback system which utilizes these 
features of the invention particularly attractive for use by automobile drivers, who can 
select their program content much more effectively and with less drive distraction than 
currently possible with a conventional automobile radio, tape or CD player. 

Program Production 

Hg. 6 shows the method followed to produce program content which is structured 
in accordance with the invention to facilitate interactive program selection, the first step 
in program production is to build a structured database of 'articles' which are candidates 
for inclusion in individual subscriber compilations. 

The authoring system seen in Fig. 6 scans a wide range of data sources 401 for 
potential content as indicated at 403. Examples of data sources might be news service 
wire feeds or newsgroups on the Internet. The authoring system subdivides the accessed 
program data into program segments (topics) and indexes each segment by subject area 
at 405. In the case of text data, this indexing may be done automatically by parsing the 
text into words and building a conventional inverted file word index to the program 
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segments. In the case of audio programming, a text transcript may be prepared using 
conventional speech recognition mechanisms to for a transcript, and the transcript may 
then be indexed by the terms used. Alternatively, human indexers may produce 
descriptive words and phrases to charactena the content of a program segment, and these 
descriptors may be used to index those segments. 

After the indexing has been performed at 405, the authoring system then conm^ 
the each program segment's index data at 407 with system wide selection criteria in a 
system oatabase 409 to pro^^ Tlie systm ffltermg Action identifies 

those programs which of potential relevance to one or more of the established subject 
matter categories offered to subscribers. Accordingly, the system filter database 409 may 
take the form of a set of words (descriptors) of known relevance associated with each of 
the subject matter categories in the catalog. The comparison fuhction at 407 scans the 
words in each candidate program segments to form a weighting value indicating the 
frequency (density) of the occuirence of descriptors for eaA 

whose content produces a high weighting value with respect to any category are 
automatically associated with that category and retained for further processing as 
indicated at 408, while program segments producing no weighting values greater than a 
p^etamined minimum may be completely discarded at this stage, as indicated at 41 1, 
since their content does not indicate a sufficient likelihood of being of interest to a 
sufficient number of subscribers. Marginal program segments may be returned to the 
source library 401 for possible later use in the event that user preferences change. 

* Each article which passes the system filter at 408 is processed as shown at 414 in 
Fig. 6. Asnotedeailier/atidasindlca^ 

a transcript for those segments which consist, in their original form, of voice narration. 
This step may be automated using speech recognition or manually by keyboarding to 
create the needed transcripts. 

As indicated at 425, when the original material cbiisisted of iiifornmtionintext 
form, a human reviewer verifies that the program content is in fact relevant to the subject 
matterxategories identified by the automated system filter pnw^ 
adds additional subject matter categories that may have been overlooked by the automated 
process. As a result of this automated and humaii-veiified classification procea^^ 
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program segment is associated with one or more subject matter categories which are 
encoded into a standard form in the Subjects array of the .Progranv Segment record 
described earlier in connection with Fig. 4. These subject codes are further assigned an 
importance value in the Importance array (which is parallel to the Subjects array) by the 
human author. Note that the order in which subjects codes are placed in the Subjects 
array may be used to indicate the relative relevance of the subjects to the program 
segment; that is, the most relevant subject is identified in SubjectsfO], the next most 
relevant subject is identified in Subjeets[l], and so on. Each program is typically placed 
in the output sequence in accordance with the code at Subject[Oj, the subject to which the" 
program segment is most relevant:' 

In addition, the human review may compose, a narrative cross referencing 
description of some or all of the program segments which were secondarily relevant to a 
given category, that is, program segments which were most relevant to another category 
but also relevant to the given category. This cross-referencing description may 
advantageously utilize the hyperlink capability discussed earlier such that, when the user 
is listening to the description of any related program segment, that related segment may 
be listened to simply by issuing a Go command to jump to the linked article, and later 
issuing a Return command to resume the playback at the original point. 

The body of the program segment is then organized by the human reviewer at 
steps 43 1, 433, and 435 seen in Fig. 6 to create an output program segment having the 
desired structure consisting of: 

(0 .a topic statement which is packaged in a separate program segment, 

(2) a leading summary paragraph, 

(3) former wntemoiganiz^ 

which all unnecessary detail is excluded (that is, longer topics are digested 
into shorter, overview topics, with the full version being made available in 
an alternative, unabridged form which is also made available to the 
listener), 

(4) adclmgliighJightidentmcation to key terms and phrases, and 

(5) adduig cross-referencing hyperlinks, with added explanatory anchor text 
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When the original program segment is a news article or the like which was made 
available in text form, the foregoing operations may be most conveniently performed on 
the text, with the conversion to audio being performed by a human announcer or by 
speofcsynmesis afters Thus, as shown 

at 436, the human reviewer may compose a hew article which has condensed content at 
431, add a topic (title) and summary paragraph previously created at 433, andthen,at 
435, add highlighting and hyperiink tags (which take me form of imbedded flags of the 
type used in Hypertext Markup Unguage^'HTML" as described later in connection with 
Fig. 7). In order to assist the listener in deciding whether to listen to, or skip, a given 
subject, it is desirable that the topic and subject announcements include a statement of the 
playing time, particularly for ionger program segments. In addition, the playing time is 
recorded in the Prognun_Segment record for that segment in the field named "Duration" 
as noted earlier. A human announcer then reads the structured text, or it is alternatively 
converted into an audio program segment by speech synthesis, as indicated at 435. 

If desired, the user may request the player to periodically issue a time of day 
announcement. The user may set a playback preference vame inmcating a desired 
duration between time of day announcements. Each time such an announcement is issued, 
the last announcement time is recorded. Each time a logical break occurs between 
program segments, the last announcement time is subtracted from the current time and, 
if the result exceeds the desired announcement spacing, a new time of day announcement 
is issued. 

In addition, at the user's option, the piayer may also periodically announce the 
duration of the unplayed portion of the session, enabling the listener to skip certain 
programs in order to play others when the actiid listening t^ 
time available to play the entire remaining program. 

The player may be programmed to issue timed messages to me listener. For 
example, a program session may mtenupte^ 

function at a particular time, such as listening to a scheduled radio broadcast. 
Ateraatrvely, the player may be programmed to play identified segments at a particular 
time of day, or * a partis time relative to ^ 
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minutes after the session begins regardless of what has been played before or where the 
player is in the sequence). These programmed interruptions are preferably performed as 
automatic hyperlink, enabling the user to return to the regularly scheduled but interrupted 
programming simply be issuing a "return" command. 

It should be noted that program segments may omit the "original" audio file 
entirely. Instead, the audio may be generated on the user's player tising speech synthesis . 
with tag to speech conversion of the tagged highlighted materials including an audible cue 
The text-to-speech technology might be especially useful for specialized subject areas 
. such as weather reports, sports scores, or stock market quotes, or other primarily 
mfbrmational articles where the content is signfficantly more important than the form of 
speech. 

• The availability of a collateral text file makes it possible to perform scanning 
operations to "find" particular words and phrases in the presentation, and perform a jump 
to that position in the file. Thus, the user may request the player to locate and play the 
next program selection in the sequence to contain the word "patent" and the player in 
response to that request, performs a serial search through the transcript text associaied 
with each program segment until the requested word is found, an a jump then executed 
to resume play at that location. 

Using conventional text indexing techniques, the transcript files of the programs 
specified on the current program schedule, as well as the transcript files of other locally 
stored programming, may accessed by means of an inverted file in which each significant 
word in the playable library is associated with the an indexing record for each occurrence 
of that word, the record containing program segment identifier for the program segment 
including the word and the offsets) within that segment where the word occurs The 
availability of that inverted file allows the player to immediately inform the user of the 
number of timetheterm occurs to avoid fhihless searches as well as searches which find 
too much, without actually scanning the transcripts. The lability of the program 
identmerpernrtot^ of categories and topics 

along wimarecitationof thenumber of word occurrences within that topic; for example 
"Thetem 'ovular' oc^^ I 
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mode facilitates the rapid review of longer, presentations by focusing only the central . 
points presented while allowing more detail to be readily accessed if desired. 

When a given program segment contains recorded original audio, such the newly 
recorded narration of a human reader or an audio recording of a broadcast radio program, 

s the file of selection records to be associated with that audio recording file is created by a 
humanedhor who utilizes suitable audo moiutoim^ 
, playback of the audio playback file and identify the byte location within that audio file 
where highlight and anchor passages as welt as response prompts which seek user input 
begin and end. In addition, for hyperlink selection records, the human editor supplies the 

10 idm ^«ti°nofmecros*r^^ 

selection record associated with the same or a difltot program se^ 
is to be passed if the hyperlink is executed by the user. A crucial step in the production of 
each segment is the association of byte locations in the audio stream with the records in 
the selection file; This association may be done by a human technician or by automatic 

15 methods. 

A technician would use a computer with suitable audio playback capabilities and 
software to play the audio stream and to simultaneously display the transcript if it is 
available. The software which plays the audio generates a new record in the segment file 
which contains the current byte location within an audio file whenever the human editor 

20 pressedakey. The significance of a byte location may be inmcated by pressing a selected 
one of apluralityofkeys. For example, the technician* could generate Subject and Topic 
records with the correct byte offset simply by pressing, the «S "or "T" keys at the right 
irtomentwhflelistei^ The sofhvare could autoimmciiUy generate 

the synchronizing segment record and prompt me teclmician to associate byte loca^^ 

25 ^K^edwimacoffe^ 

other positional identification means. When no transcript is available, the operator may 
be prompted to enter a topic or subject description via the keyboard. 

The process of associating of audio location with segment records process could 
be automated by adding additional software to the technicians editing computer. For 

10 example, as indicated at 437, speech recognition technology may be employed to 
automatically identify when the live speaker changed in an audio stream . The monitoring 
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lur me segment which identifipe aii u 

as explained below, the use ofHTMT tn 

r i~ • 81 438 m y content cross-referencing links and th**» 

^ m — * locatfon references to cros.referenc^ Droa l 

particular nassa^* ™rt, ; „ enced Program segments or 

>*^«d4^iuM M ^^ ™« to u« th tS e .ymbofcc nroe, as 
««ui«««s,jusi as symbolic names are used to IHa^a, .jj 

c in cms way, symbolic names used to identify cross-re*™,.^ 
^B^l,^^^^^ m . ^^referenced 

Maecnon me onset values loaded into the 
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Location field in "L" Selection_Records. As discussed previously, these offset values are 
either positive values specifying the location within the Selections file of the 
SelectionRecords which identifies the link target, or negative ProgramJD values which 
identify program segments not specified by the current Selections file as being part of the 
current program session content. 

Comment Handling 

As previously discussed in connection with Figs. 3 arid 5, the apparatus 
contemplated by the invention advantageously includes means for accepting comments, 
yes/no responses, and value selections from a user during a playback session. As 
discussed in more detail below under the heading 'TJefining Audio Programming with 
HTML," these prompted user input responses are analogous to and can be composed 
using the <NPUT> tag form elements defined for use in standard hypertext markup 
language, where the "C" records in the selection file are analogous to <INPUT 
TYPE^'texf^ HTML tags, the "Y" selection file records are analogous to <INPUT 
TYPE="checkbox"> tags, the "V" records are analogous to <3NPTJT TYPE="radio"> 
radio button tags: Together these prompt mechanism provide a robust .mechanism for 
prompting the user for and collecting responses of various kinds. 

This mechanism for obtaining prompted responses may be advantageously 
employed to request information from subscribers. For example, prompted requests may 
be used to obtain program ratings from at least those subscribers who are willing to 
participate in the program rating process. Using and "E" records, for example, a user 
may be asked to grade programs by various criteria and the resulting data may then be 
used alone or in conjunction with other values to produce a figure of merit for 
progranuning, whereby programs receiving higher ratings can be assigned a higher 
priority. In a similar fashion, willing subscribers may be offered the opportunity to 
volunteer to participate in surveys of various kinds, with the added advantage, that 
personal and preference data already available for each of the participants may be 
combined with the survey responses is useful ways. For example, the tendency to give a 
negative responses on a particular topic may be correlated with the age, sex, geographic 



63 



WO 99/431 1 1 



PCT/US98/03444 



location, etc. of the respondents. Subscribers who are participate in the surveys may be 
rewarded by providing reduced subscription rates, free programs, or cash payments. 

As discussed previously in connection with Fig. 3 and 263-264, the embodiment 
which described also includes the capability of accepting comments from a subscriber at 
any time during the course of program playback. When such a comment is recorded, it 
is saved as separate file (or other identifiable data) together with the ProgramJD of the 
program commented upon, the byte location within the playing program file where the 
comment or annotation is being made, a Class variable indicating the nature of the record, 
the Class variable being used as the Class variable in the Program_Segment record for the 
comment or annotation or comment, and the date and time of day when the comment is 
being created When the comment is created, the user is then requested to specify, either 
by voice response or by a keyboard selection, whether the information to be recorded is 
to be treated as: 

1. An annotation to be appended to the playing program record; or 

2. A comment which is treated as an independent message/program segment. 

The user further indicates the extent to which such an annotation or comment is 
to be made available to others. If designated as being public, annotations become 
available to any other subscriber who subsequently plays the program, at least to the 
extent that a given subscriber indicates that the playback of annotations is desired. Private 
annotations are simply stored in the user's local disk storage are (at 107 in Fig. 1) for 
future reference whereas public annotations are uploaded to the server where they are 
saved as separate files keyed to the original by means of the downloaded selections file for 
those subscribers who desire to hear annotations. 

Comments are designated as being public or private messages. Public comments 
become independently available to all subscribers who have indicated an interest in the 
subject matter category(s) to which the comment relates. By default, a comment is 
assumed to relate to the same categories assigned to the program segment which was 
playing when the comment was produced, but these category codes may be changed by 
the user during the editing session (seen at 217 in Fig. 2). In addition to altering the 
subject matter codes for comments already dictated, the editing capabilities made available 
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to the user at step 217 may advantageously include the ability to delete dictated comments 
so that they are not uploaded at all, direct comments to specific subscribers or email 
addresses, and enter new comments on any designated program segment in the current 
catalog by dictation or keyboarding. 

In order to provide an appropriate program description for longer topics, 
whenever a user records a comment have a duration which exceeds a predetermined 
elapsed time, the player 103 performing the recording (at 264 in Fig. 3) produces an audio 
announcement request-that the user dictate a brief summary of the comment which is 
used to form the topic description for the longer program segment Li the catalog listing 
provided to subscribers who desire access to comments as well as programs in a particular 
subject matter area, comments are listed in outline form as items which are subordinate 
to the parent program or comment to which they relate. The CommentOn field found in 
the Program_Segment record for each comment provides the information needed to 
display the hierarchical tree. The pubHc consent mecl^ 

of the invention provides a useful facility which enables subscribers to exchange 
information with each other in special interest groups which function much like the 
UseNet groups on the Internet, but with a conversational ease and informality that audio 
recording makes possible. 

A subscriber can elect the degree to which public comments or annotations are to 
playedba^alongwimprogransortopicsofspec^^ Comments or annotations 

can be excluded entirely, a Unk may be imbedded % which may be executed at user request 
to play the comment or annotation at the point in the file where the comment or 
annotation was played, or all comments and annotations may be played immediately 
without first requesting user approval. 

Private comments are not posted to the subject matter categories and are made 
available only to (1) the author of [specified by the Provider_ro ofj me program 
being commented upon; (2) the host system, or a host system editor responsible for the 
subject matter area about whjch the comment is concerned; or (3) some other destination 
specified by the user. By sendl^ consents to the author, me user can inake a direct but 
private response to anything contained in a message or program created by that author. 
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Particular advertisers or other content providers may encourage such comments and offer 
subscriber credits or other incentives to those who are willing to make comments. 

The ability to send comments to the responsible host editor provides a direct 
mechanism by which a subscriber may express satisfaction or dissatisfaction about the 
programming content provided, suggest other programming which would he of interest, 
and the like. Moreover, the to-host comment provides a mechanism to assist the editors 
to identify subscribers who may be inappropriately injecting offensive material to the 
annoyance of other subscribers. In addition, questions about the operation of the system 
may be directed to the host, thereby providing help and customer support to subscribers 
whoinayneed assistance. Finally, the host may provide additional services (feet finding, 
transaction processing, and the like) which are made available on a fee basis to interested 
subscribers. 

Finally, the ability to direct comments to specific people allows the system to 
provide voice-mail like functions among subscribers. Using speech recognition, dictated 
comments may be translated into text messages that could be sent to anyone having an E- 
maa address or facamile receiver. Alternatively, the comment could be transmitted as an 
audio file attachment to an E-mail message (e.g. as a RealAudio file). In addition, like 
private annotations, the comment may simply be placed on the user's local disk for future 
reference. 

Comments and annotations are pretty stored on the placer's loed 
unit with header information designating a CommentON field (the ProgramJD of the 
program jiegment commented on), the byte location in the playing program file where the 
comment was dictated, the Class field specifying the nature of the comment, and the 
Created date and time stamp. The files containing public and private annotations and 
comments (other than those designated for the sole use of the subscriber which remain on 
the local storage unit) are uploaded to the host at the same time the usage log is 
transferred (see 219, Fig. 2). 

Defining Audio Programming with HTML 

Nainmveterftooepra 
by the present invention may be advantageously expressed in the first instance using 

66 



WO 99/431 11 v „ 

PCT/US98/03444 

essentially conventional hypertext markup language, "HTML". Fig. .7 shows an example 
of the content of a portion of an illustrative HTML text file indicated generally at 450 
used to create an audio file seen at 460 and a selections file indicated at 470. 

The HTML file illustrated at 450 uses conventional <IMG> tags to identify image 
files, conventional emphasizing tag pairs <EM> and <EM> to designate highUghted 
passages, and conventional e > and </A> HTML tag pairs to designate the anchor text 
and Jink target of a hypertext link. Utilizing conventional HTML to describe the narrative 
content to be presented in audio form provides several significant advantages, not the least 
of which are: 

(a) conventional HTML composition software may be used to add the image 
and emphasis tags by means of visual tools which eliminate the need for 
hand-coding on a character level; 

(b) a narrative text version of the audio prograniming may be viewed and 
printed, including both the emphasized text and the imbedded images, 
using most popular web browsers; 

(c) existing HTML files may be readily converted into audio multimedia 
presentations with little or no HTML editing being required; 

(d) HTML file may be made available from a server in a form which can be 
viewed in the normal way by any web browser yet and alternatively 
presented accordance with the invention in the form of an interactively 
browsable audio program with synchronized images; 

(e) the HTML file may be supplied along with the audio-file as a transcript for 
the audio presentation, and to permit the audio presentation to be indexed 
and searched; and 

(f) the HTML may be automatically converted into the combination of an 
audio file using conventional speech synthesis techniques to process the 
naxnmvetextwtomeHTMLtagsbeii^ 

which enables the player to interactively browse the audio file using 
highlighted and linked passages, and to synchronize the image presentation 
with the audio file. 
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As seen inFig. 7, the HTML text passage seen at 450 begins with an image tag 
<MG SRC-IMGFJLE1 W>, which to specify that the display of JPEG image i„ the 
f U enan^«MGFII £l Wshou,dbeginatthatpoint The image tag is translated into 

theoisplayofthatimageisto begin. This display continues until the next <IMG> tag is 

encountered sped^ AelMGFII^ JPG iniage which creates the T" and V selection 

recordpairat473. The<LMGQFF> is not standardHTML and hence would be ignored 

by conventional web browsers, but is inserted for recognition by the selections file 

compuerwWchresponds^^^ 

which the current image display should end. 

Immediately thereafter, the phrase "Television and motion pictures" is identified 
as a bghhghted passage by the tag pair <EM> and «EM> seen in the text 450 These 
tagsaretranslatedintome^an^ 

identify the beginning and ending of the phrase in the audio file. As discussed earlier in 
conjunction with Fig. 5, the highlight markers in the selections file enable the player to 
play oidy the highlighted passages when in the highlight mode. A second «W and *E» 
record pair seen at 476 is produced by the HTML text "<EM>bandwidth<yEM>» 

A conventional HTML hypertext anchor "<A HREF='target'>fuIl motion 
video</A>» is processed to produce the three records "A", «B» and«L" at 478 in the 
selections file which respectively designate the beginning and ending of the anchor text 
passage and the location of a linked informatioa The "HREF^target- portion of the 
HTML specifies the target location in conventional HTML and that symbolic address is 
thentranslatedbyt^^ 

the selections file record whichrefers to that target or, for ta^m program segment, 
which are not part of the currently scheduled programming defined by the selections file 
by a negative number representing the negative of me ProgramlD number of the targei 
program segment. 

The HTML forms mechanism may also be used to incorporate requests for user 
mputatpredete^ As described 

eariia mC onnectionw«hFig.5,userinpu^ 



68 



WO 99/43111 



PCT/US98/03444 



annotations which are analogous to the <INPUT TYPE="text"> and the <TEXTAREA> 
tagged requests in an HTML form which similarly request the recipient to supply text 
data. In addition, the embodiment of the invention which has been described incorporates 
a mechanism for accepting "YES'7"NO M selections from a user which is analogous the 
HTML form <NPUT TYPE="checkbox"> tag. Similarly, the value choice mechanism 
using "V" selection records provides a radio-button-style mechanism for indicating a 
user's choice from among several options. 

Standard HTML input tags include a Name attribute which can be used as an 
identifier for the data entered. As HTML is translated into an equivalent audio file, the 
tags in the written HTML are translated into records in the selections file which contain 
byte location values specuying when the player should pause tiie playback and accept the 
user response. The resulting uploaded usage log file (containing responses to radio and 
checkbox input tags) contains the response value together with the original byte location 
value from the selections file which serves the tag identifier. In order to facilitate 
processing of the responses, the HTML to audio conversion process may advantageously 
save a table correlating the Name values in the HTML source with the byte location 
values. In this way, the input tag Name parameter may be used as a symbolic identifier 
to identify and process response data. 

The HTML input tag Value parameter is conventionally used to supply a default 
response value to be supplied when the user does not supply a different response. Value 
parameters may accordingly be saved for later use and inserted as output data when the 
user does not respond to the request for input (as indicated by the absence in the uploaded 
files of any response data containing the byte location value forthe tag not responded to). 
In the same way, hidden HTML tags may be imbedded in the original HTML and saved 
during the HTML to audio conversion to indicate the correspondence between particular 
byte locations in the audio file and symbolic location names identified by the symbolic 
Name parameter specified in the hidden tag. Such hidden tags may be used, for example, 
to identify the beginning and end of particular passages and may be compared with the 
usage logs to determine the extent to which users exercised their option to skip the 
remainder of a program during the designated passage. 
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Conclusion 

It is to be understood that the embodiment of the invention which has been 
described is merely illustrative of one application of the principles of the invention. 
Numerous modifications may be made to the specific structures and functions used in that 
embodiment without departing from the true spirit and scope of the invention. 
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What is Claimed is: 

1 . A personalized electronic information delivery system comprising, in combination, 
a host subsystem comprising: 

a file storage server for storing a library of program segments, at least some of 
which include natural language text recorded in digital compressed form, 

means for storing a category description for each of a plurality of subject matter 
categories, 

means for storing* program (description of each of said program segments, each 
of said program descriptions including the identification of one or more of said subject 
matter categories to which the described program segment belongs, 

means for storing a subscriber description of each of a plurality of subscribers, 
each of said subscriber descriptions containing information indicative of particular subject 
matter categories designated as being of interest to the described subscriber, 

means for compiling a personalized catalog of suggested program segments for 
a given one of said subscribers, said personalized catalog consisting of category 
descriptions and program descriptions selected in accordance with the subscriber 
description for said given subscriber, 

means for transmitting said personalized catalog upon request, and 

means for transmitting identified ones of said program segments upon request, 
a data communications pathway, and a client player device located remotely from said file 
storage server, said player device comprising, in combination: 

means for establishing a bi-directional data transfer connection between said player 
device and said file storage server, 

means fer transferring infbrrr^onto sdd host system for mclusionm a subscriber 
description for a designated subscriber having access to said player device, 

means for transmitting to said host system a request for a personalized catalog 
compiled for said designated subscriber, 

means fi>r receiving the requested catalog from said host subsystem, 
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means for transmitting said to ssid host system a request for one or more desired 
ZZ'J™" ^ "~ SU8geSted ^ h *• ■ 

me^lbrrec^sddd^pro^s^^^^^^ 
means for nsproducmg s9 ld oatur^ to.^ «« to a foJm comprehensil)|e ,„ „ 
tanan user from selected oiies of ssid program segments. 

recording of spoken natural language text. 

A system as set forth in claim 2 wherein said ho« ,ubsy««n toner includes 
o^sfcringdigfc, tor^re^.^p, oft ie*,. porn™ of ^ 
natural language text recorded in at least some of said program segments. 

4. A persons elecuonic information delivery system as set forth in data , 
wh^u, aatd natu*. toguage « ^ m compressed fbrmcon.* of digits, d to 
-.^.aeonencoofw^.^ « text charactos^d therein ^dme^s for 
reproducmg *d naur* tangn^ ^ to . ^ comfnMto a ^ " 

compmes speech sy*hesi s me»s for convening said word »,. »«, ^ foIra 
understandable to a human listener. 

5- A P™^ electronic inft^^^ 

where* ^ subset desoripdons include inibrmttion describing the States of a 
^bscriberand^^se,^^ 

subscriber attribute ^ mjba)e> 0{mbsc . bm to ^ ^ 

•eseHbed^^^w^^^^^^^ 
penonabzed «*g indudes m«ns fcr m^ me fa „.„ 

ne^npuon, to the subscriber MM. im^ontastfd l ^d« ra i BO on. 
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6. A stem as set forth in claim 5 wherein said subscriber attribute information, 
specifies the age of said subscriber and wherein said program descriptions specify the ages 
of subscribers to whom the described segment may be of interest. 

7. A system as set forth in claim 5 wherein said subscriber attribute information 
specifies the sex of said subscriber and wherein said program descriptions specify the sex 
of subscribers to whom the described segment may be of interest. 

8. A system as set forth in claim 5 wherein said- subscriber attribute information 
specifies the marital status of said subscriber and wherein said program descriptions 
specify the marital status of subscribers to whom the described segment may be of 
interest. 

9. A system as set forth in claim 5 wherein said subscriber attribute information 
specifies the geographic location of said subscriber and wherein said program descriptions 
specify the geographic location of subscribers to whom the described segment may be of 
interest. 

10. A personalized electronic information delivery system as set forth in claim 1 
wherein at least some of said category descriptions further contain information indicative 
of other cross-referenced subject matter categories to which the described category is 
related and wherein said means for compiling said catalog includes means, fpr including 
said cross-referenced category descriptions in said catalog. 

11. A personalized electronic information delivery system as set forth in claim 1 
wherein said data communications pathway is a digital transmission system and wherein 
said file storage server stores said programs in identified files which may be transmitted 
via said digital transmission system. 

12. A personalized electronic information delivery system as set forth in claim 1 1 
wherein each of said program descriptions includes means for identifying one or more files 
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stored onsaid file storage serverwhich relate to the program segment described by that 
program description. 



13. A personalized electronic information delivery system as set forth in claim 1 
wherem said host subsystem further comprises: 

means for receiving from a subscriber via said conimunications pathway a search 
request for the identification of program segments satisfying criteria specified in said 
search request, 

means for compiling a listing of said programs satisfying said criteria, and 
means for transmitting said listing to that subscriber which issued said search 
request. 

14. A personalized electronic information delivery system as set forth in claim 1 
wherein said host subsystem further comprises means for compiling a program schedule 
consKting of an ordered sequence of selected ones of said program segments and means 
for transferring said program schedule to said client player via said communications 
pathway, and wherein said cUempU^in^ means for reproducing said selected ones 
of said program segments. 

15. A system as set forth in claim 14 wherein said client player includes means for 
reproducing said selected ones of said program segments in the order specified in said 
program schedule. 

16. A system as set forth in claim 14 wherein said dient player includes means for 
altenngsaidprogram schedule to form an edited schedule and means for producing the 
program segments in the order specified in said edited schedule 

17. AsvslemassetfbrmmclaimM 

storing program segments received from said host subsystem, means for comparing the 
specification of program segments contained in said program schedule with the identity 
of program segments locally stored by said client player, and means for transmitting a 
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request to said server subsystem for programs segments specified in said program 
schedule but not locally stored by said client player. 



18. A personalized electronic information delivery system as set forth in claim 1 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes means for processing said 
usage log to produce billing information for said subscriber. 



19. A personalized electronic information delivery system as set forth in claim 1 
wherein said client player system includes means for recording a usage log containing the 
10 identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said catalog 
of suggested program segments at least some of the program segments identified on said 
usage log as having been played. 
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20. A personalized electronic information delivery system as set forth in claim 14 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said 
program schedule at least some of the program segments identified on said usage log as 
having been played. 

21 A personalized electronic information delivery system comprising, in combination, 
an Internet host subsystem comprising: 

afile storage server for storing a plurality of program segments, at least some of 
which include natural language text recorded in digital compressed form and stored as 
named retrievable files, 

means for storing a category description for each of a plurality of subject matter 
categories,. 
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means for storing a program description of the information content of each of said 
program segments, each of said program descriptions including the identification of one 
or more of said subject matter categories to which the described program segment 
belongs, 

means for storing a subscriber description of at least one subscriber, said 
subscriber description containing information indicative of particular subject matter 
categories designated as being of interest to said subscriber, 

means for compiling a personalized catalog of suggested program segments for 
use by said subscriber; said personalized catalog consisting of category descriptions and 
program descriptions selected in accordance with said subscriber description, 
a port for establishing a data communications pathway to the Internet, 
means for transferring said personalized catalog to said subscriber, and 
means for transmitting identified ones of said program segments to said subscriber 
upon request, and 

a client player device accessible to said subscriber at a geographic location remote 
from said host subsystem, said player device comprising, in combination: 

means for establishing a data transfer connection via the Internet between said 
player device and said Internet host subsystem, * 

means for transferring information describing said subscriber to said host system 
for inclusion in said subscriber description, 

means for transmitting to said host system a request for a said personalized 
catalog, 

means for receiving the requested catalog from said host subsystem, 

means for transmittingsaid to said host system a request for one or more desired 

program segments selected from the suggested program segments in the requested 

catalog, and 

means for receiving said desired program segments from said host system, and 
means for reproducing said natural language text in a form comprehensible to a 
human user from selected ones of said program segments. 
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22. A personalized electronic information delivery system as set forth in claim 21 
wherein said natural language text recorded in compressed form consists of a digital audio 
recording of spoken natural language text. 

23. A system as set forth in claim 22 wherein said host subsystem further includes 
means for storing digital data representing a transcript of at least a portion of the spoken 
natural language text recorded in at least some of said program segments. 

'■ • 

24. A personalized electronic information delivery system as set forth in claim 21 
wherein said natural language text recorded in compressed form consists of digital data 
representing a sequence of words expressed as text characters and wherein said means for 
reproducing said natural language text in a form comprehensible to a human user 
comprises speech synthesis means for converting said word into audible spoken form 
understandable to a human listener. 

25. A personalized electronic information delivery system as set forth in claim 21 
wherein said subscriber descriptions include information describing the attributes of a 
given subscriber and wherein at least selected ones of said program descriptions contain 
subscriber attribute information specifying the attributes of subscribers to whom the 
described program segment may be of interest, and wherein said means for compiling a 
personalized catalog includes means for matching the attributes in said subscriber 
descriptions to the subscriber attribute information in said program descriptions. 

26. A system as set forth in claim 25 wherein said subscriber attribute information 
specifies the age of said subscriber and wherein said program descriptions specify the ages 
of subscribers to whom the described segment may be of interest. 

27. A system as set forth in claim 26 wherein said subscriber attribute information 
specifies the sex of said subscriber and wherein said program descriptions specify the sex 
of subscribers to whom the described segment may be of interest. 
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28. A system as set forth in claim 27 wherein said subscriber attribute information 
specifies the marital status of said subscriber and wherein said program descriptions 
specify the marital status of subscribers to whom the described segment may be of 
interest. 



29. A system as set forth in claim 28 wherein said subscriber attribute information 
specifies the geographic location of said subscriber and wherein said program descriptions 
specify the geographic location of subscribers to whom the described segment may be of 
interest. - . . 

30. A personalized electronic information delivery system as set forth in claim 21 
wherein at least some of said category descriptions former contain information indicative 
of other cross-referenced subject matter categories to which the described category is 
related and wherein said means for compiling said catalog includes means for including 
said cross-referenced category descriptions in said catalog. 

31. A personalized electronic information delivery system as set forth in claim 21 
wherein said data communications pathway is a digital transmission system and wherein 
said file storage server stores said programs in identified files which may be transmitted 
via said digital transmission system. 

32. A personalized electronic information delivery system as set forth in claim 31 
wherein each of said program descriptions includes means for identifying one or more files 
stored on said file storage server which relate to the program segment described by that 
program description. 

33. A personalized electronic information delivery system as set forth in claim 21 
wherein said host subsystem further comprises: 

means for receiving from a subscriber via said communications pathway a search 
request for the identification of program segments satisfying criteria specified in said 
search request, 
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means for compiling a listing of said programs satisfying said criteria, and 
means for transmitting said listing to that subscriber which issued said search 
request. 

34. A personalized electronic information delivery system as set forth in claim" 21 
wherein said host subsystem further comprises means for compiling a program schedule 
consisting of an ordered sequence of selected ones of said program segments and means 
for transferring said program schedule to said client player- via said communications 
pathway, and wherein said client player includes means for reproducing said selected ones 
of said program segments. 

35. A system as set forth in claim 34 wherein said client player includes means for 
reproducing said selected ones of said program segments in the order specified in said 
program schedule. 

36. A system as set forth in claim 34 wherein said client player includes means for 
altering said program schedule to form an edited schedule and means for reproducing the 
program segments in the order specified in said edited schedule 

37. A system as set forth in claim 34 wherein said client player includes means locally 
storing program segments received from said host subsystem, means for comparing the 
specification of program segments contained in said program schedule with the identity 
of program segments locally stored by said client player, and means for transmitting a 
request to said server subsystem for programs segments specified in said program 
schedule but not locally stored by said client player. 

38. A personalized electronic information delivery system as set forth in claim 21 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes means for processing said 
usage log to produce billing information for said subscriber. 
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39. A personalized electronic information delivery system as set forth in claim 21 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said catalog 
of suggested program segments at least some of the program segments identified on said 
usage log as having been played. 

40. A personalized electronic information delivery system as set forth in claim 37 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said 
program schedule at least some of the program segments identified on said usage log as 
having been played. 

41 A communications system for distributing audio recordings among a plurality of 
system subscriber stations located remotely from one another, said system comprising: 
a communications network interconnecting said system subscribers, 
a subscriber access device connected to said network at each of said subscriber 
stations, said access device comprising: 

playback means for reproducing a selected audio recording received from said 
network for a listener, 

input means for accepting a spoken message from said listener concurrently with 
the reproduction of said selected audio recording, 

means for recording said spoken message and identification data associating said 
spoken message with said selected audio recording to form a subscriber generated 
recording, and 

means for transmitting said subscriber generated recording over said network, and 
routing means coupled to said network and responsive to said identification data for 
transferring said subscriber generated recording to one or more of said subscribers. 
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42.. A communications system as set forth in claim 4 1 wherein said spoken message 
is an audio annotation to be appended to said selected audio recording and wherein said 
identification data includes the specification of a chosen position in said selected audio 
recording to which said audio annotation relates. 

43. A communications system as set forth in claim 42 wherein said input means 
includes means actuated by said listener for initiating the acceptance of said spoken 
message and wherein said chosen position is the position in said selected audio recording 
being reproduced when said acceptance was initiated by said listener: 

44. A communications system as set forth in claim 42 wherein said routing means 
includes means for transferring said subscriber generated recording of said audio 
annotation to subscribers who thereafter receive transfers of said selected audio recording. 

45. A communications system as set forth in claim 44 wherein said playback means 
includes means responsive the receipt of a subscriber generated recording of an audio 
annotation for playing said audio annotation when said position is reached during the 
playback of said selected audio recording. 

46. A communications system as set forth in claim 41 wherein said identification data 
is indicative of at least one subject matter category and wherein said routing means 
includes: 

means for storing data identifying a subset of subscribers having an interest in 
information within said one subject matter category, and 

means for transferring said subscriber generated recording to one or more of said 
subscribers in said subset. 

47. A communications system as set forth in claim 46 wherein said at least one subject 
rnatter category is a subject matter category associated with said selected audio recording. 
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48. A communications system as set forth in claim 46 wherein said routing means for 
transferring said subscriber generated recording to said subscribers in said subset includes 
means responsive to preference data supplied by a receiving subscriber for encouraging 
or inhibiting the transfer of said subscriber generated recording to said receiving 

s subscriber. 

49. A communications system as set forth in claim 4 1 wherein said selected audio 
recording was produced by an originating subscriber and wherein said routing means 
includes means for transferring said subscriber generated recording as a response to said 
originating subscriber. 

10 50. A communications system as set forth in claim 49 further including means for 
storing the identification of a subset of subscribers who have an interest in each of a 
plurality of subject matter topics, wherein said identification data further includes the 
specification of one or more subject matter topics to which said subscriber generated 
recordings relate, and further including means for traiisferring to those subscribers having 

is. an interest a given topic an idenn1fi<^on of subscriber generated recordmgs wU^ 
the specification of said given topic. 

51. Apparatus for exchanging information relating to a plurality of subject matter 
topics between a plurality of participants located remotely from one another, said 
apparatus comprising, in combination: 
20 an electronic data communications network interconnecting said participants, 

one or more audio recording unto coupled to said network for recording audio 
messages spoken by each of said participants, 

means for persistently storing each given one of said audio messages with 
identification data designating one or more of said subject matter topics to which said 
2S given audio message relates, 

means for prodding to a requesting participant an identffication of previously 
stored messages relating to a subject matter topic specified in a request for information, 
and 
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an audio playback unit for reproducing stored messages specified in said 
identification. 

52. Apparatus as set forth in claim 51 wherein each of said audio recording units 
includes means operable by a participant for recording a comment relating to a particular 
previously stored message wherein the identification data stored with said comment 
designates one or more of the subject matter topics to which said previously stored 
message relates. 

53. Apparatus as set forth in claim 52 further including: 

means for persistently storing pre-recorded programs each of which relates to one 
or more of said subject matter topics, and 

means for additionally providing a requesting participant an identification of pre- 
recorded programs relating to a subject matter topic specified in a request for information. 

54. Apparatus for obtaining information responsive to request for information request 
which comprises, in combination, 

means for recording said request for information as an audio recording containing 

a spoken request prompt and a recorded request marker specifying a position in said audio 

recording subsequent to said request prompt, 

playback means for reproducing said spoken request prompt for a listener, 
input means initiated bysaid recorded request marker for temporarily suspending 

the operation of said playback means while accepting a spoken response from said listener, 

and 

recording means for storing said spoken response together with identification data 
designating said request. 

55: Apparatus as set forth in claim 54 wherein said identification data comprises a 
designation of said audio recording and a designation of the position of said request 
marker in said audio recording. 
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56. Apparatus as set forth in claim 54 wherein said input means further comprises 
means actuated by said listener for initiating the acceptance of a spoken message and 
wherein said recording means further comprises means for storing said spoken message 
together with a designation of said audio recording and a designation of the position in 
said audio recording at which the acceptance of said spoken message was initiated by said 
listener. 



57. A method for producing and processing an audio questionnaire comprising, in 
combination, the steps of: 

storing an electronically readable file of text characters consisting of natural 
language text and at least one response request marker mdicating a position relative to 
said natural language text where a response is to be inserted by a human listener, 

using speech synthesis processing to convm said electroiii^ readable file of text 
characters into a corresponding audio file of spoken natural language, 

converting said response request marker in said file of text characters into timing 
data indicating said position in said audio file, 

reproducing said audio file for said human listener, 

temporarily suspending the reproduction of said audio file at said position in said 
audio file indicated by said timing data, and 

accepting and recording a spoken response from said listener while said 
reproduction is temporarily suspended. 

58, A method as set forth in claim 57 for producing and processing an audio 
questionnaire wherein said response request marker further specifies a selected one of a 
group of predetermined response types. 



59. Amethod as set forth in claim 58 wherem said a group of predetermined response 
types includes a spoken response recorded stored as an audio recording and a spoken 
response recorded as a one a predetermined set of data values. 
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60. A system for storing and reproducing audio programming concurrently with the 
synchronized display of one or more stored images which comprises, in combination,. 

means for storing sequential digital data representing an audio program, 

means for storing a digital data representing an visible image, 

means for storing synchronizing information specifying a limited portion of said 

sequential digital data representing a designated passage within said audio program, 

audio player means for reproducing said audio program by converting said 

sequential digital data into audible form, and 
. meaiwforvisuaUydisplay^ 

of said designated passage. 

61. A system for storing and reproducing audio programming as set forth in claim 1 
wherein said means for storing sequential data representing an audio program comprises 
means for storing a file of natural language text and wherein said audio player means for 
reproducing said audio program comprises speech synthesis means text file into audible 
spoken form. 

62. A system as set forth in claim 60 wherein said synchronizing information 
comprises one or more records identifying a said digital data representing said visible 
image and fiuther identifying locations within said sequential digital data which 
correspond to the beginning and end of said designated passage. 

63 . A computer system for storing and reproducing audio programming concurrently 
with the synchronized display of one or more visible images, said system comprising, in 
combination.mass for storing sequential digital data representing said audio 
programming, image data representing said visible image, and synchronizing data relating 
said image data to an identifiable contiguous portion of said sequential file, 

a display for converting said image data into said visible image, and 

processing means for processing means for converting said sequential digital data 
into an audible signal and for activating said.display means to display said visible image 
beginning and ending at times specified by said synchronizing data. 
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64. A ^to Sto ™g^re prodl ^ mdioprtgra ^ Msaforthbdto4 
v*™ m* for spring dltt m ^ pr()gran ^ 

reproduce ,dd audio program comprise, ^ manls ^ . fc ^ 

spoken form. 

65. '^^h^^^^^^ 

^"^^^nch^^d^ 

me™ for storing « sequential digital file representing natural language tot 
mporpora^prede,^ 

positions in said -natural language text, 

means for storing image data representing one or more visual images : 
speech synthesis means for converting said sequential digital file into audible speech 
representing said natural language text in spoken form, and 

"^fo'detectmgto 
digital file to produce one or more control values, and 

disphymeansresponsiveto said controls for producing said visual images at ^ 
predetermined times relative to said audible speech. 

66. A computer system as set forth in claim 65 wherein said sequential digital file 
rep^g natural lanijuage text is expressed in cottventional hypertext markup language 
which is displayable and printable using a conventional web browser. 

67. A computer system as set forth in claim 66 wherein said tag markers include 
hypertext markup language image tags of the form <MG SRC=»IrnageID»> whe re 
ImageTOisasymbohcvanableidenti^ 

wherein the position of each such image tag specifies the time relative to said audible 
speech whim said visual image is displayed by said display means. 
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68. A computer system as set forth in claim 66 wherein said tag markers include 
hypertext markup language text formatting tags which specify particular highlight 
passages in said natural language text and further including means for detecting said 
formatting tags to produce playback control values and means responsive to said playback 
control values to selectively reproduce said highlightpassages in spoken form. 

69. A computer system as set forth in claim 66 wherein said tag markers include 
hypertext markup language link markers which specify particular anchor passages in said 
natural language text and further including means for detecting said link markers to 
produce link control values and means jointly responsive to said link control values and 
to a requestfrom a user for performing a jump to different position in said digital 
sequential file at which different position said speech synthesis - means continues the 
conversion of said sequential digital file into audible speech. 

70. A computer system as set forth in claim 67 wherein said tag markers further 
include hypertext markup language text formatting tags which specify particular highlight 
passages in said natural language text and further including, means for detecting said 
formatting tags to produce playback control values and means responsive to said playback 
control values to selectively reproduce said Wghlight passages in spoken form. 

71. A computer system as set forth in claim 67 wherein said tag markers include 
hypertext markup language link markers which specify particular anchor passages in said 
natural language text and further mduding means for detecting said link markers to 
produce link control values and means jointly responsive to said link control values and 
to a request from a user for perfonning a jump to different position in said digital 
sequential file at which different position said speech synthesis means continues the 
conversion of said sequential digital file into audible speech. 

72. A system for storing and reproducing natural language text in both spoken and 
written which comprises, in combination, 
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ineans for storing sequential digital data representing an audio program containing 
spoken text, 

means for storing a digital data representing a sequence of characters fonning a 
transenpt of said spoken text in said audio program, 

meansforstorings^^ 
designated spoken passage in said audio program and a location of the corresponding 
sequence of characters in said transcript corresponding to said spoken passage 
audio player means for reproducing said audio program by converting said sequential 
digital data into audible foim, and 

means responsive to said synchronizing information for visually displaying said 
corresponding sequence of characters concurrently with the reproduction of said 
designated spoken passage. 

of. ttrget seoue.ee of characters for searchbg said t^p, for , 

mlaudtop^co^.^^^^^ 
of characters in said transcript. 

74. A system for delivering pre-recorded programs to a subscriber comprising, in ' 
combination: 

meansforston^alib^ 

meansforstoringc^goryd^^ 
categories, 

meansforston^p*^ 

matter categories to which each of said programs relates, 
means for storing data describing a plurality of subscribers, including data 
designating at least one of said categories for each of said subscribers, 
ineansforcoinpari^said^ 

with said program description data to compile an identffication of program segments of 
potential interest to said given subscriber, 
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means for tnmsferring said identification of programs to said given subscriber, 
means responsive to a request from a subscriber for transferring requested 

program segments from said library to the requesting subscriber, and 

means for receiving from said requesting subscriber a usage log identifying the 

program segments actually used by said requesting subscriber. 

75. A system as set forth in claim 74 wherein said identification of programs 
transferred to said subscriber comprises a program schedule consisting of an ordered 
sequence of program identifiers: 

76. A system as set forth in claim 75 further includes a player device accessible to each 
of said subscribers for reproducing said program segments specified by said program 
identifiers in the order specified by said program schedule. 

77. A system as set forth in claim 75 further including means for excluding from said 
program schedule for any subscriber the identification of any program segment previously 
identified as actually used by that subscriber in a usage log. 

78. A system as set forth in claim 77 wherein said program schedule comprises 
programs*** in said specification received from said given subscriber and fiirther 
comprises additional programs selected by comparing said data describing said given 
subscriber whh said program description data. 

79. A system for delivering pre-recorded programs to a subscriber comprising, a host 
subsystem comprising: 

means for storing a library consisting of a plurality of separate program segments, 
means for storing category definition data describing a plurality of subject matter 
categories, 

means for storing program description data specifymg, for each given one of said 
program segments, at least one of said subject matter categories to which said given one 
of said program segments relates, 
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me^for8torii«subscriberdatadescribing8phjra% including data 

designating at least one of said categories for each of said subscribers, 

means for comparing said data describing at least a given one of said subscribers 
with said program description data to compile a catalog of program segments, each 
catalog containing an identification of a set of program segments of potential interest to 
said given subscriber and a narrative description of the programs segments identified in 
said catalog, 

means for transmitting said catalog to said given subscriber, 
means for receiving from said given subscriber a specification of programs identified 
in said catalog, 

means for transmitting to said given subscriber a program schedule consisting of an 
ordered sequence of program identifications, and 

means responsive to a request from said given subscriber for traiisferring requested 
program segments from said fibraiy to said given subscriber, and 

a player device accessible to said given subscriber for selectively reproducing said 
program segments specified by said program identifiers in the order specified by said 
program schedule, said player device further comprising: 

recording means coupled to said player deviw for recordmg a usage log containing 
an identification of each program segmemactuaUy played by said player device, and 

means for transmitting said usage log to said host subsystem. 

80... Asy8temassetformmdaim79iiiclu^ 

player device for storing program segments transferred from said library to said given 
subscriber. 

81. Asystemassrtforthtac^ 

editing means operable by said subscriber for modifying said program schedule. 

82. A system as set forth in claim 80 further including means for excluding from said 
program schedule for any subscriber the identification of any program segment previously 
identified as actually used by that subscriber in a usage log. 
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83 : A system as set forth in claim 79 wherein said program schedule comprises 
programs in said specification received from said given subscriber and further comprises 
additional programs selected by comparing said data describing said given subscriber with 
said program description data. 

84. A system as set forth in claim 82 further including means for excluding from said 
program schedule and said catalog for any subscriber the identification of any program 
segment previously identified as actually used by that subscriber in a usage log. 

85. A system as set forth in claim 79 further including means for processing said usage 
logs to adaptively modifying said subscriber data to indicate of the character of programs 
actually used by each of said subscribers. 

86. A system for delivering pre-recorded programs to a subscriber comprising, in 
combination: 

means for storing a library consisting of a plurality of separate program segments, 
means for storing category definition data describing a plurality of subject matter 
categories, 

means for storing program description data specifying at least one of said subject 

matter categories to which each of said programs relates, 

means for storing subscriber data describing a plurality of subscribers, including data 
designating at least one of said categories for each of said subscribers, 

means, for comparing said data describing at least a given one of said subscribers 
with said program description data to compile a catalog of program segments, each 
catalog containing an identification of a set of program segments of potential interest to 
said given subscriber and a narrative description of programs segments identified in said 
catalog, 

means for transmitting said catalog to said given subscriber, 
; means operable by said given subscriber for selecting a set of desired program 
segments from said catalog, 



91 



WO 99/43111 

PCT/US98/03444 

means for raving from said given subscriber . specification said „ of desired 
programs, 

ordered sequence of program identifications, • 

^ re ^<o«r*,u«from,,«|^ 
segments from said library to the requesting subscriber, and 

program segments actually used by said requesting subscriber. 

*7. . A system as set forth in claim 86" further includes a player device accessible to each 
of .art subscribe for reproducing .aid program segments specified by said prog™ 
identifiers in the order specified by said program schedule. 

■^schedutefbranys^u*^ 

,dew,fied u acta ' ll y <"»d by that subscriber in a usage log. 

Pr0gram * *■ describtog said subscriber vriti, sai(1 

program description data. 

». A asset form mcto 89 

program schedufe and said ottdog&r any sutacriber the idemalcrion of any program 
•egment ■dentifed as actually used by that siibscrW ma usage log. 

«• A ^»««i»cta86 S «r«i m I 1 ^ n ^ fcrpro ^ Mid 
actually used by said subscribers. 
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92. A system as set forth in claim 86 wherein said subscriber data further includes data 
indicating the total duration of playing time available to at least selected ones of said 
subscribers and means for limiting the playable duration of the program segments 
identified in said ordered sequence in accordance with said total duration. 

93. A system as set forth in claim 91 further includes means responsive to said usage log 
for modifying said playable duration in accordance with the percentage of segments 
previously skipped by said requesting subscriber. 

94. A system as set forth in claim 86 including means for transmitting to said subscriber 
an indication of optimum times for requesting the transfer of requested program segments. 

95. A system as set forth in claim 86 further wherein said subscriber data further 
comprises an indication the time of day when a playing session is scheduled to begin for 
said requesting subscriber on each day of the week. 

96. A system as set forth in claim 95 wherein said subscriber data further comprises an 
indication of the expected duration of said playing session for said requesting subscriber 
on each day of the week. 

97. A player for reproducing selected audio program segments comprising, in 
combination: 

means for storing a plurality of program segments, each of said program segments 
having a beginning and an end, 

means for storing data establishing a sequence in which said program segments are 
scheduled to be reproduced by said player, 

means for accepting control commands from a user of said player, 

means for reproducing said program segments in the order established by said 
sequence in the absence of a control command, 

means for detecting a first command indicative of a request to skip forward, and 
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means responsive to said first command for discontmuing the reproduction of the 
currently playing program segment and instead continuing the reproduction at the 
beg.nn.ng of a program segment which Mows said currently playing program in said 

sequence. . 

98.. AP"^-*fc4hdfc97»*.«^ - , 11Illlia|r4l|M1|l ^ t 

command indicative of a request to aldp backward, and 

mean, response to . single one of said second commands for mscormnuing the 
reproduction of to currency playtag- ^ „„ ^ ^ 

reproduction at the beginning of said currently playing program. 

99. A player as set forth in claim 98 taher comprising means responsive to to 
of .wo corcecutive one, of said second commands tor discontinubg to 
"Production of to curmmy piaytag program segment and instt*d continumg to 

program segment 

*9°- A. player as set forth in claim 97 wherein said sequence established by said data 
forms an endless circular sequence of program segments 

^ player as set forth in chum 97 including editing means for modifying said data 
establishing said sequence. 

102. A player a, set forth to chum 101 whereto «ud ediung means include, means fo, 
reordering to sequence established by said data. 

103. ^^mmkA^n^m^m^t,,^,^^^ 

segmems includes mean, for vuying to rate a, which said program ugmem, are 
reproduced. 



94 



WO 99/43111 

PCT/US98/03444 

104. ^^^mMki^ip^^^^^^^^^^ 

sa.d program segments are reproduced includes means for skipping periods of silence 
between words or other sounds when said program segments are reproduced. 

105. A player as set forth in claim 103 wherein said means for varying said rate 
comprises means for designating portions of said program segments as highlight passages 
and means responsive to a request from aid user for reproducing said higMight passages 
without reproducing at least someportions of said program segments which are adjacent 
to said highlight passages. 

106. A player as set forth in claim 97 wherein said means for reproducing said program 
segments including means for accepting a bookmarking request from said user, means for 
storing bookmark data indicating.the program segment being reproduced at the time said 
bookmarking request is accepted. 

107. A player as set forth in claim 97 wherein said program segments include 
descnpbve program segments, each given descriptive segment containing information 
which when reproduced for the listener describes the content of one or more other 
program segments which immediate follow said given descriptive segment, and 

wherein said player further comprises means responsive to said first command and 
operative when one of said descriptive segments is currently playing for discontinuing the 
reproduction of said currently playing descriptive segment and instead continuing the 
reproduction at the beginning of the next descriptive segment in said sequence. 

108. A player as set forth in claim 97 wherein said player further comprises: 
m ^^ringdatain*^ 

of said program segments, and 

means responsive to a predetermined one of said control commands for 
reproducing only the highlight passages within said selected program segments. 
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A player m m . M m ^ ^ ^ ^ ^ 

no. Ap^g™^^^^^^ opBW-< - ' 

compnslnfcfo combination: "computer 

input means for accepting control comiiiands from a user 

°* fOT » anrfog . udi0 ^ 

^o g ^^^ tosddo ^_ for ^- = 
program segments in a form audible to said user. 

d^mmumg U* a^on of tbe cunenuy program ^J^ZZ 

_ processing meaas responsive U. a ^ on. of „id comrol con*™, for 
•nutalatton^th. beginning of said currently pla^g proi|ron . 8 

ctam .4 fcrther compnsbg me™ raiK)Mive to ,„„ co^ecmiv. ones of said second 
currently playing program in said sequence. 

rtum,fr^^ M ^ fare ^^°^"«^» 
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said descriptive segment in said sequence arid wherein said processing means responsive 
to said a first one of said cpntrol commands continues the translation at the beginning of 
the next descriptive command when the currently playing program segment is a descriptive 
segment 

113. A programmed digital computer as set forth in claim 16 wherein said input means 
comprise a microphone for accepting voice commands spoken by said user 

-.1 14. A player device for interactively reproducing selected audio program segments 
from a program library comprising, in combination: 

storage means for storing a plurality of program segments each containing an 
audio presentation; 

means for storing a program schedule establishing an ordered sequence of said 
program segments to form a continuously playable audio program session; 

output means for converting the audio presentation at a current playback position 
in said session into an audible form perceivable by a listener, 

means for identifying at least one hyperlink anchor passage within said session; 

means for associating said anchor passage with a linked playback position in said 
session different from the playback position of said anchor passage; 

means for producing an output indication perceivable to said listener whenever 
said hyperlink anchor passage is reproduced by said output means; 

input means for accepting a hyperlink execution commands from a listener, and 
means responsive to said execution command for changing said current playback position 
in said session to said linked playback position. 

115. A player device as set forth in claim 1 14 wherein said output indication is an 
audible cue signal produced in timed relation to the reproduction of said anchor passage. 

116. A player device as set forth in claim 1 14 wherein said means for identifying said 
anchor passage comprises an anchor passage identifier stored with said program schedule. 
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vmgm passages within session, and means responsive to a reject 

passage.and means responsive to a nan***** pnve 
a library server storing aid jot^ ^ 

amunuaicatioiB&dlity, "Tary server vi» said 

"wans for Boring, progro,,^^^ . 

v output means for converting the audio presentation - ' 
^^idena^^^^^^^ 

Iwednfc anchor tmmm i. , ^ ^ ^ ^ 

■xe-nsre^Kmme to extorto, Mmmaod ,„ . . "<»» «'*«»«; and 

msaidst^ntosaidlh^ptoyb ack p oaiW<lI|L , Tny ° u * i ' l0 »*«»' 
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120. A player device as set forth in claim 1 19 wherein said output indication is an audible 
cue signal produced in timed relation to the reproduction of said anchor passage. 

121. A player device as set forth in claim 119 wherein said means for identifying said 
anchor passage comprises an anchor passage identifier stored with said program schedule. 

122. A player device as set forth in claim 121 further comprising means for identifying 
a plurality of highlight passages within session, and means responsive to a request from 
said Ustener for playing said highlight passages without playing other portions of said 
session. 

123. A player device set forth in claim 119 including means for identifying subject 
description passages within said session, each given descriptive passage containing 
information describing of a portion of said session which follows said given descriptive 
passage, and means responsive to a request from said Ustener for reproducing the next 
descriptive passage in said session following said current playback position in said session. 

124. Aplayer device as set forth in claim 1 19 wherein said library server includes means 
for producing said program schedule and said player device includes means for receiving 
said program schedule from said library server 

125. AsystemforreiOTducii«sdectedprogra^ 
from a program library comprising, in combination: 

a library server storing said program library; 

a communications facility for transferring program segments from said library server 

tojilayerdevicestacatedremotelyfromsaid program library, each of said player devices 
comprising: 

means for receiving a plurality of program segments from said library server via said 
communications facility 
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for storing , ^ ^ m onfered 

means for identifying at least one hyperlink anchor passage within said session' 
^ OD ^ ta ' l »«po 5 iti«- 0 f 8 aid anchorpaSMge . M ' d 

hyperlink anchor passage is reproduced by said output means' 

■"Putm^for^copting.,^^^,,^ ■ 

127. A player device set forth in claim i j- 

. . m cBum 126 ^eluding means for identifying subie^ 

description passages within said sessioa each pi™ ^ • • J 
infem,-^.! n.- "wSion, each given descriptive passage containing 

"fh^on describing ofaportfcn of said session wMch follows said given desc^I 

^passagein^ 

128. Aplayerdevi«asset£br4indam 

««d program schedule from said Kbraryserver. "'receiving 
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a mass storage device for storing a plurality of digitally recorded audio program 
segments, each of said segments haying a beginning and an end, and further storing data 
establishing a sequence in which said program segments are scheduled to be played, 

means for storing an associated program type designation for each of said recorded 
audio program: segments, 

input means for accepting control commands from a user, 
output means for producing audible sounds in response to analog audio signals, 
processing means for translating said digitally recorded audio program segments into 
analog audio signals delivered to said output means for reproducing said recorded 
program segments in a form audible to said user, said processing means being responsive 
to a user request for selectively inhibiting the reproduction of program segments specified 
by said user request . 

130. An audio program player as set forth in claim 129 wherein said program type 
designations include designations of announcement program segments and wherein said 
means for selectively inhibiting comprises means for inhibiting the reproduction of 
program segments designated as being announcement program segments. 

131. An audio program player as set forth in claim 129 wherein said program type 
designations include designations of advertisement program segments and wherein said 
means for selectively inhibiting comprises means for inhibiting the reproduction of 
program segments designated as being advertisement program segments. 

132. A system for reproducing selected program segments containing audio presentations 
from a program library comprising, in combination: 

a library server storing said program library, 

a cmmunications facility for transferring selected program segments from said libraiy 
server to player devices located remotely from said program library in response to 
program segment requests from said player devices, each of said player devices 
comprising: 
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communications facility. 

mmm for storing . program . ^ ■ 

plurahty of p rograra segmem, „ fonn a pl>yab|e ^ ^ 

«• Wii semen into an audible pereeiv>b , e ^ , 

ordered sequence but which art not stored in Mid local storage means, and means for 

™" A ^«»'*^'^P^^ -<1 , ill41 . -lta - Jt 

server. ^ 

segments to a listener comprising, in combination, the steps of 

storing e«h of said aeparate programming .egmem. as. ffl. of digits data, 
^•tase.ofco. ta ,l Iraros ^ ch , pe ^ Map ^^^ towi ^ 

saa programming segments are to be reproduced, 

«*r p^sage m on. « mmm ^ ^ „ ^ ^ 

l«*ed passage in one of said files, 

said first set of control records, 

^'i^comn^fc^dlis^ 
wth the presentation of said anchor passage, and 

^^P-^^ots M ^ tt ^ l ^ ottlKb ^ 
asocaated linked passage. ' 
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135. The method as set forth in claim 134 further including the step of accepting a slap 
command from said listener during the presentation of at least selected ones of said 
programming segments and resuming the presentation of said segments at the beginning 
of the next segment in said proposed sequence in response to said skip command. 

5 136. The method of claim 135 further wherein some of said segments are subject 
description segments which precede programming segments described thereby, said 
method further comprising the step, performed in response to said skip command when 
a subject description segment is being presented, of resuming the presentation of said 
segments at the beginning of the next subject description segment in said proposed 
10 sequence. 

137. The method of claim 134 further comprising the step of storing a file of digital data 
representing a file of natural language characters forming a transcript of at least a 
transcribed one of said audio programming segments and further storing a third set of data 
representing locations within said transcribed audio program segment of corresponding 

15 locations in said file of characters. 

138. Thememodofdaiml37mdudii«mestepofdisplaym^ 

to said user, accepting from said listener the designation of a selected location within said 
displayed file of natural language text, and responsive to said designation presenting said 
transcribed audio segment to said listener at a position m said traiiscribed audio segment 
20 corresponding to said selected location in said file of characters. 
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